Intel® Artificial Intelligence Workshop: Deep Learning at Scale using Distributed Frameworks

Date: Thursday, October 10, 2019, 13:30-17:00
Location: LRZ Building, Garching/Munich, Boltzmannstr. 1, LRZ Hörsaal
Contents:

The demand of using Deep Learning techniques in many scientific domains is rapidly emerging and the requirements for large compute and memory resources is increasing. One of the consequences is the need of the high-performance computing capability for processing and inferring the valuable information inherent in the data. The Leibniz Supercomputing Centre (LRZ) has recently installed its new high-end system, SuperMUC-NG. Based on Intel® technology, it targets among others also workloads at the crossroads of AI and HPC.

In this session you will learn various optimization methods to improve the runtime performance of Deep Learning algorithms on Intel® architecture. We cover how to accelerate the training of deep neural networks with Tensorflow, thanks to the highly optimized Intel® Math Kernel Library (Intel® MKL). We also demonstrate techniques on how to leverage deep neural network training on multiple nodes on a HPC cluster.

Schedule:

13:30 - 15:30

  • Performance optimized Frameworks solutions from Intel
            Tensorflow, Caffe, Pytorch, and others
  • Performance acceleration with Intel MKL and Intel MKL-DNN for Deep Neural Network

15:30 - 16:00 Coffee break
 
16:00 - 17:00

  • Accelerate Training and Inference of Distributed solutions on HPC (MPI) environments using Xeon (x86)
            Distributed Tensorflow with Horovod
            Distributed Machine Learning with Daal4py
Prerequisites:

Basic knowledge of Python

Certificates of attendance for

All participants are expected to bring their own laptops.

Language: English
Contact:

F. Baruffa (Intel®), Shailen Sobhee (Intel®), J. Albert-von der Gönna (LRZ)

Fabio Baruffa is a senior software technical consulting engineer at Intel. He provides customer support in the high performance computing (HPC) area and artificial intelligence software solutions at large scale. Prior to Intel, he has been working as HPC application specialist and developer in the largest supercomputing centers in Europe, mainly the Leibniz Supercomputing Centre and the Max-Plank Computing and Data Facility in Munich, as well as Cineca in Italy. He has been involved in software development, analysis of scientific code and optimization for HPC systems. He holds a PhD in Physics from University of Regensburg for his research in the area of spintronics devices and quantum computing.

Shailen Sobhee is a software Technical Consulting Engineer in the field of Artificial Intelligence at Intel. He is the link between the core engineering team and Intel's customers. As an AI consultant, Shailen assists and trains customers on how to use machine learning and deep learning frameworks that capitalize on highly-optimized mathematical libraries for best performance on Intel hardware. He holds a Master's degree in Computational Science and Engineering from the Technical University of Munich.

Registration: Via the LRZ registration form. Please choose course HIDL1W19.
Material:

Slides 1

Slides 2

Labs

If you attended this course, please don't forget to rate it. We highly appreciate your feedback:
https://survey.lrz.de/index.php/691527