Deep learning

Back to Program

High-Performance Deep Learning

Our course on high-performance machine learning provides the necessary skills to train neural networks and extract the most relevant information from datasets. During our hands-on sessions you will have the opportunity to work on our high-performance systems with different types of data, and learn how to tune your model to obtain optimal results in the most efficient way. The first day will focus on basic deep learning knowledge and skills. The second day will focus on training neural networks on high-performance computing clusters.

Day 1

• Understand the fundamental theories of machine learning and the intuitions/ideas behind the algorithms
• Work with a high-level machine learning API (Keras)
• Explore hyperparameter space to improve a neural network
• Understand the pitfalls of classic machine learning algorithms

Day 2

• how to set up your software environment, and why the preinstalled software modules are useful
• how the file I/O might limit your training speed, and how to overcome that
• about the technical capabilities of modern day CPUs and GPUs (reduced precision datatypes, vector/matrix instructions)
• how to find bottlenecks in your code through creating a (PyTorch) profile
• how to use multiple CPUs or GPUs in a single training (parallel computing for deep learning)