IN5550 – Neural Methods in Natural Language Processing
This course studies a selection of advanced techniques in Natural Language Processing (NLP), with particular emphasis on recent and current research literature. The focus will be on machine learning and specifically ‘deep’ neural network approaches to the automated analysis of natural language text. Topics will typically include representation learning for words (and possibly larger linguistic units), classification using Convolutional Neural Networks, and applications of various types of Recurrent Neural Networks to sequence labeling and the analysis of grammatical or semantic structure. The course includes strong practical components and puts emphasis on NLP problems and (potentially large) datasets of central importance in current research. Thus, students will be prepared to pursue an experimental, research-oriented MSc project in Natural Language Processing.
Upon completion of this course you:
- are familiar with common techniques for learning dense representations (‘embeddings’) of natural language;
- understand the basics of various types of neural networks and their applications to natural language processing;
- can apply off-the-shelf NLP tools in meaningful ways to the data preparation for representation learning;
- have basic knowledge of the concepts of transfer and multi-task learning in application to natural language problems;
- can design, excecute, analyze, and summarize large-scale experiments in common neural network toolkits;
- know how to assess the benefits and challenges of neural learning in contrast to other common approaches in NLP;
- are able to identify and critically read relevant NLP research literature
Admission to the course
Students admitted at UiO must apply for courses in Studentweb. Students enrolled in Master's Degree Programmes not belonging to IFI can, on application, be admitted to the course if this is cleared by their own study programme.
Nordic citizens and applicants residing in the Nordic countries may apply to take this course as a single course student.
If you are not already enrolled as a student at UiO, please see our information about admission requirements and procedures for international applicants
Recommended previous knowledge
- 10 credits overlap with IN9550 – Neural Methods in Natural Language Processing.
- 5 credits overlap with INF5820 – Language technological applications (discontinued).
- 5 credits overlap with INF9820 – Language technological applications (discontinued).
Four hours of instruction per week, mostly split into two hours of lectures and another two hours with hands-on (computer) laboratory work.
Mandatory assignments must be approved in order to qualify for the final exam. Previously approved assignments remain valid for one year.
Home exam (a practical project and summary report) which counts 100% towards the final grade.
It will also be counted as one of your three attempts to sit the exam for this course, if you sit the exam for one of the following courses: IN9550 - Advanced Topics in Natural Language Processing
Grades are awarded on a pass/fail scale. Read more about the grading system.
Resit an examination
Students who can document a valid reason for absence from the regular examination are offered a postponed examination at the beginning of the next semester. Re-scheduled examinations are not offered to students who withdraw during, or did not pass the original examination.