Deep Neural Networks (ELE680)

In this course, you will be introduced to the foundations of deep learning, the most effective and common network structures and how to build, train and evaluate deep neural networks for different applications.


Course description for study year 2024-2025. Please note that changes may occur.

Facts

Course code

ELE680

Version

1

Credits (ECTS)

5

Semester tution start

Autumn

Number of semesters

1

Exam semester

Autumn

Language of instruction

English

Offered by
Time table

View course schedule

Content

NB! This is an elective course and may be cancelled if fewer than 10 students are enrolled by August 20th for the autumn semester.

In this course, you will be introduced to the foundations of deep learning, the most effective and common network structures and their applications and how to build, train and evaluate deep neural networks for different applications. This includes:

  • Neurons, layers, back propagation,  optimizers,  loss functions, hyperparameters 
  • Unsupervised, supervised  and semi-supervised learning approaches.
  • Transfer learning
  • Multilayer Perceptron Network (MPN)
  • Convolutional Neural Network (CNN)
  • Time Series analysis
  • Reccurent Neural Network (RNN) and Long Short-Term Memory networks (LSTMs)
  • Autoencoders
  • Natural language processing (NLP)
    • Natural Language Understanding (NLU) and Embeddings.
  • Image classification and Object detection
  • Video Activity recognition
  • Deep Reinforcement Learning
  • Deep learning in image reconstruction and medical imaging. 
  • Transformers

Learning outcome

At the end of this course the student should have a fundamental understanding of methods and deep neural network structures commonly used in deep learning. The student should  also be able to build, train and evaluate models for one or more practical deep learning problems.

Required prerequisite knowledge

None

Recommended prerequisites

ELE520 Machine Learning

Exam

Form of assessment Weight Duration Marks Aid
Project assessement 1/1 Letter grades

Coursework requirements

2 assignments

2 of 2 assignments need to be approved by course instructor within the specified deadlines.

Course teacher(s)

Course teacher:

Øyvind Meinich-Bache

Course teacher:

Vinay Jayarama Setty

Course teacher:

Trygve Christian Eftestøl

Course teacher:

Kjersti Engan

Head of Department:

Tom Ryen

Method of work

The course has a duration of approximately 8 weeks and will be completed mid October. Lectures will be held the first 5 weeks. The students are expected to spend additional 6-8 hours a week on self-study and assignments.

The project will be carried out in the last three weeks of the course and it is expected that each student spend about 15 hours per week.

Course assessment

There must be an early dialogue between the course supervisor, the student union representative and the students. The purpose is feedback from the students for changes and adjustments in the course for the current semester. In addition, a digital subject evaluation must be carried out at least every three years. Its purpose is to gather the students experiences with the course.

Literature

The syllabus can be found in Leganto