SubjectsSubjects(version: 928)
Course, academic year 2019/2020
Neural Networks - AM445004
Title: Neural Networks
Guaranteed by: Department of Computing and Control Engineering (445)
Faculty: Faculty of Chemical Engineering
Actual: from 2019 to 2020
Semester: summer
Points: summer s.:5
E-Credits: summer s.:5
Examination process: summer s.:
Hours per week, examination: summer s.:2/2, C+Ex [HT]
Capacity: unlimited / unlimited (unknown)
Min. number of students: unlimited
Language: English
Teaching methods: full-time
For type: Master's (post-Bachelor)
Guarantor: Mudrová Martina Ing. Ph.D.
Procházka Aleš prof. Ing. CSc.
Incompatibility : M445004
Interchangeability : M445004
Is incompatible with: M445004
Is interchangeable with: M445004
Examination dates   Schedule   
Last update: Cejnar Pavel RNDr. Mgr. Ph.D. (14.06.2022)
The course is focused on comprehension of commonly used neural network architectures, suitable for various types of solved problems and processed data. Lectures cover the necessary theory, but are mainly focused on practical aspects of neural network design. For seminars, students will try to train the designed models of neural networks and further optimize them.
Last update: Cejnar Pavel RNDr. Mgr. Ph.D. (14.06.2022)

Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press, 2016.

Last update: Cejnar Pavel RNDr. Mgr. Ph.D. (14.06.2022)

Feed-forward neural networks

  • basic architectures and activation functions
  • optimization algorithms for training
  • selection of hyperparameters

Regularization of neural network models

  • commonly used regularization techniques - dropout, label-smoothing

Convolutional neural networks

  • convolution layers, normalization
  • architectures suitable for deep convolutional neural networks
  • pre-training and fine-tuning of deep neural networks

Recurrent neural networks

  • basic recurrent networks and problems of their training
  • bidirectional and deep recurrent networks

Transformer architecture

Design and optimization of neural networks in various environments - Python, MATLAB