Distributed Deep Learning with Horovod Training Course

Horovod is an open-source software framework designed to facilitate the rapid and efficient development of distributed deep learning models using TensorFlow, Keras, PyTorch, and Apache MXNet. It enables the scaling of a single-GPU training script to run on multiple GPUs or hosts with minimal code modifications.

This instructor-led, live training (available both online and onsite) is tailored for developers or data scientists who aim to utilize Horovod to execute distributed deep learning training sessions and scale them up to operate across multiple GPUs in parallel.

By the end of this training, participants will be able to:

• Set up the required development environment to initiate deep learning training processes.
• Install and configure Horovod for training models with TensorFlow, Keras, PyTorch, and Apache MXNet.
• Scale deep learning training with Horovod to run on multiple GPUs simultaneously.

Format of the Course

• Interactive lectures and discussions.
• Extensive exercises and practical activities.
• Hands-on implementation in a live-lab environment.

Course Customization Options

• This course focuses on Horovod, but other software tools and frameworks such as TensorFlow, Keras, PyTorch, and Apache MXNet may be necessary. Please inform us if you have specific requirements or preferences.
• To request a customized training for government agencies, please contact us to arrange.