Skip to main content

Deep Neural Networks ELE680

In this course, you will be introduced to the foundations of deep learning, the most effective and common network structures and how to build, train and evaluate deep neural networks for different applications.


Course description for study year 2022-2023. Please note that changes may occur.

Facts
Course code

ELE680

Version

1

Credits (ECTS)

5

Semester tution start

Autumn

Number of semesters

1

Exam semester

Autumn

Language of instruction

English

Content
In this course, you will be introduced to the foundations of deep learning, the most effective and common network structures and their applications and how to build, train and evaluate deep neural networks for different applications. This includes:
  • Neurons, layers, back propagation,  optimizers,  loss functions, hyperparameters 
  • Unsupervised, supervised  and semi-supervised learning approaches.
  • Transfer learning
  • Multilayer Perceptron Network (MPN)
  • Convolutional Neural Network (CNN)
  • Time Series analysis
  • Reccurent Neural Network (RNN) and Long Short-Term Memory networks (LSTMs)
  • Autoencoders
  • Natural language processing (NLP)Natural Language Understanding (NLU) and Embeddings.
  • Image classification and Object detection
  • Video Activity recognition
  • Deep Belief Networks
  • Deep Reinforcement Learning
  • Deep learning in image reconstruction and medical imaging. 
Learning outcome
At the end of this course the student should have a fundamental understanding of methods and deep neural network structures commonly used in deep learning. The student should  also be able to build, train and evaluate models for one or more practical deep learning problems.
Required prerequisite knowledge
None
Recommended prerequisites
ELE520 Machine Learning
Exam
Form of assessment Weight Duration Marks Aid
Group project 1/1 Letter grades

The assigned project is carried out in groups of two students. Exceptionally, it can be one or three students per group. The report describes and documents work in the project. The report is made in collaboration with all the participants in the group and all participants will get the same grade. An oral presentation of the project is a mandatory part of the project.There is no resit exam in this course. A new project report must be submitted the next time the course is taught.

Coursework requirements
2 assignments
2 of 2 assignments need to be approved by course instructor within the specified deadlines.
Course teacher(s)
Course coordinator: Øyvind Meinich-Bache
Coordinator laboratory exercises: Ketil Oppedal
Course teacher: Øyvind Meinich-Bache
Course teacher: Vinay Jayarama Setty
Course teacher: Mahdieh Khanmohammadi
Course teacher: Krisztian Balog
Course teacher: Kjersti Engan
Head of Department: Tom Ryen
Method of work

The course has a duration of approximately 8 weeks and will be completed mid October. Lectures will be held the first 5 weeks. The students are expected to spend additional 6-8 hours a week on self-study and assignments.

The project will be carried out in the last three weeks of the course and it is expected that each student spend about 15 hours per week.

Course assessment
Form and/or discussion.
Literature
The syllabus can be found in Leganto