Official course description:
Full info last published 30/11-20

Natural Language Processing and Deep Learning, MSc (Summer University)

Course info
Language:
English
ECTS points:
7.5
Course code:
KSNLPDL2KU
Participants max:
15
Offered to guest students:
yes
Offered to exchange students:
yes
Offered as a single subject:
no
Programme
Level:
MSc. Master
Programme:
MSc in Computer Science
Staff
Course manager
Assistant Professor
Course semester
Semester
Forår 2021
Period
Summer 2021
Start
12 July 2021
End
27 August 2021
Exam
Exam type
ordinær
Internal/External
ekstern censur
Grade Scale
7-trinsskala
Exam Language
GB
Abstract
This course is an introduction to Natural Language Processing and Deep Learning.
Description

This course is relevant for those students who wish to be exposed to applications of machine learning techniques.

Subjects:
  • An introduction to the major core topics in Natural Language Processing: language modelling, POS tagging and syntactic parsing. 
  • An introduction to basic Neural Networks for Natural Language Processing, and a corresponding Python-based framework. 
  • A project-based introduction to current Deep-Learning-based Natural Language Processing research.
Formal prerequisites

Before the course, the student should: 

  • be able to use basic algorithms and data structures when programming (equivalently, have passed the Algorithms and Data Structures course)
  • be able to use basic algorithmic techniques to design algorithms for a given problem 
  • be able to carry out basic n-dimensional matrix/vector computations by hand (e.g., matrix and vector products, addition, scalar multiplication, subtraction, etc.) 
  • hold a deep understanding of basic concepts in Statistics (e.g., distributions, summary statistics, law of large numbers, ?) 
  • be a strong Python programmer, but with some understanding of statically typed, pre-compiled languages (like C++ or Java).

Intended learning outcomes

After the course, the student should be able to:

  • Describe three core Natural Language Processing (NLP) tasks and implement basic respective computational approaches: language modelling, POS tagging, syntactic parsing.
  • Identify and formulate a task for NLP.
  • Identify why a given Neural Network architecture may be appropriate for an NLP task.
  • Design and carry out a sound experimental method for Neural-Network based NLP research.
  • Analyse the results of an NLP experiment.
  • Find, extract and explain results in the NLP and Deep Learning research literature relevant for a given problem.
Learning activities

The course will be divided into two phases : 

  1. Lecturing phase: A lecturing phase in which student are lectured and carry out appropriate exercises. This phase is meant to introduce the core NLP tasks and basic learning with Neural Networks. 
  2. Research phase: A  project phase involving the implementation of a Deep Learning-based system from Natural Language Processing research.

Mandatory activities
There will be two mandatory exercises involving writing, coding an presentation in class.

The student will receive the grade NA (not approved) at the ordinary exam, if the mandatory activities are not approved and the student will use an exam attempt.

Course literature

The course literature is published in the course page in LearnIT.

Student Activity Budget
Estimated distribution of learning activities for the typical student
  • Preparation for lectures and exercises: 5%
  • Lectures: 25%
  • Exercises: 25%
  • Assignments: 25%
  • Project work, supervision included: 20%
Ordinary exam
Exam type:
C: Submission of written work, External (7-point scale)
Exam variation:
C1G: Submission of written work for groups
Exam submisson description:
Not decided, if submission will have and individual part
Group submission:
Group
  • See above

Time and date
Ordinary Exam - submission Fri, 13 Aug 2021, 08:00 - 14:00