Natural Language Processing and Deep Learning
This course is an introduction to Natural Language Processing and Deep Learning.
This course is relevant for those students who wish to be exposed to applications of machine learning techniques.
- An introduction to the major core topics in Natural Language Processing: language modelling, POS tagging and syntactic parsing.
- An introduction to basic Neural Networks for Natural Language Processing, and a corresponding Python-based framework.
- A project-based introduction to current Deep-Learning-based Natural Language Processing research.
Formal prerequisitesBefore the course, the student should: be able to use basic algorithms and data structures when programming (equivalently, have passed the Algorithms and Data Structures course) be able to use basic algorithmic techniques to design algorithms for a given problem be able to carry out basic n-dimensional matrix/vector computations by hand (e.g., matrix and vector products, addition, scalar multiplication, subtraction, etc.) hold a deep understanding of basic concepts in Statistics (e.g., distributions, summary statistics, law of large numbers, ) be a strong Python programmer, but with some understanding of statically typed, pre-compiled languages (like C++ or Java).
Intended learning outcomes
After the course, the student should be able to:
- Describe three core Natural Language Processing (NLP) tasks and implement basic respective computational approaches: language modelling, POS tagging, syntactic parsing
- Identify and formulate a task for NLP
- Identify why a given Neural Network architecture may be appropriate for an NLP task
- Design and carry out a basic experimental method for Neural-Network based NLP research
- Analyse the results of an NLP experiment
- Find, extract and explain results in the NLP and Deep Learning research literature relevant for a given problem
Ordinary examExam type:
D: Written report with oral defence, internal (7-trinsskala)
The exam consists of three parts: 1) An oral exam. 2) A written report. 3) Project code. Duration of the oral exam: 20 minutes per student.