DAMSL-287 Neural Networks and Learning of Hierarchical Representations
Type
Course Code
Teaching Semester
ECTS Credits
Syllabus
The scientific activity of the last decade revealed many new directions and highly successful extensions of Neural Networks towards learning data representations for various perception systems. Representations of this kind are composed of many layers of nonlinear calculations (multilayer architectures) and are based on classic artificial neural networks. In recent years it has become evident that learning such multilayered representations can contribute to a significant improvement in perception systems performance. The purpose of this course is to present an introduction to artificial neural networks and in learning hierarchical representations based on those network structures. The course will focus on architectures, methodologies and algorithms, and will also include laboratory exercises.
Learning Outcomes
- Having attended and succeeded in the course, the student is able to describe the probabilistic foundations of deep generative models and gain knowledge about various model architectures, training algorithms and their underlying principles.
- Having attended and succeeded in the course, the student is able to comprehend the application areas of deep generative models in fields like computer vision, language and speech processing.
- Having attended and succeeded in the course, the student is capable of applying learned concepts to implement and train deep generative models and utilize these models for tasks such as synthetic tabular data generation, time-series synthesis and generative image processing.
- Having attended and succeeded in the course, the student is able to analyze and compare different deep generative models, understanding their strengths and limitations and critically assess the performance of these models in various scenarios.
- Having attended and succeeded in the course, the student is able to develop new approaches in deep generative modeling and distill information from research papers and practical demonstrations to create innovative solutions.
- Having attended and succeeded in the course, the student is able to critically evaluate the effectiveness of deep generative models in real-world applications and assess the impact of these models in advancing the field of generative AI.
Student Performance Evaluation
Homework and/or Lab Assignments, Final Exam and/or Project
Prerequisite Courses
Linear Algebra, Probabilities