NVIDIA GPU Programming - Extended Training Course
This instructor-led, live professional development course examines the methodologies for programming GPUs to execute parallel computing workloads. It provides comprehensive guidance on utilizing diverse computational platforms, mastering the CUDA ecosystem and its capabilities, and implementing rigorous optimization protocols within CUDA. These competencies support critical government operations, including deep learning analysis, large-scale data analytics, advanced image processing, and complex engineering simulations.
This course is available as onsite live training in US Government or online live training.Course Outline
Overview
Foundations of Heterogeneous Computing Frameworks
The Imperative for Parallel Computing: Addressing Modern Computational Demands
Multi-Core Processors: Architectural Principles and Design Standards
Thread Management: Core Concepts in Parallel Programming Paradigms
Foundations of GPU Software Optimization Workflows
OpenMP: Establishing Standards for Directive-Based Parallel Execution
Practical Application: Executing Complex Workloads on Multi-Core Systems
Foundations of GPU-Accelerated Computing
Leveraging GPUs for High-Performance Parallel Tasks
GPU Programming Frameworks and Architectural Models
Practical Application: Deploying Applications on GPU Hardware
SDKs, Toolchains, and Configuration of GPU Development Environments
Utilizing Specialized High-Performance Libraries
Practical Demonstration: Integrating GPU Tools, Sample Code, and OpenACC Standards
Comprehending the CUDA Programming Framework
Analyzing the CUDA Hardware Architecture
Configuration and Deployment of CUDA Development Environments
Implementing the CUDA Runtime Application Programming Interface
Optimizing CUDA Memory Management Strategies
Advanced Utilization of CUDA API Capabilities
Efficient Global Memory Access: Techniques for Optimization in CUDA
Enhancing Data Throughput: Leveraging CUDA Streams for Transfer Optimization
Strategic Use of Shared Memory Resources in CUDA
Implementing Atomic Operations and Synchronization Instructions in CUDA
Applied Example: Digital Image Processing Workflows Using CUDA
Scalable Multi-GPU Computational Strategies
Advanced Performance Profiling and Sampling on NVIDIA / CUDA Platforms
Implementing CUDA Dynamic Parallelism for Adaptive Kernel Execution
Synthesis of Key Findings and Final Recommendations
Requirements
- C Language Programming Proficiency
- Linux GCC Compiler Environment
Runs with a minimum of 4 + people. For 1-to-1 or private group training, request a quote.
NVIDIA GPU Programming - Extended Training Course - Booking
NVIDIA GPU Programming - Extended Training Course - Enquiry
NVIDIA GPU Programming - Extended - Consultancy Enquiry
Testimonials (1)
Trainers energy and humor.
Tadeusz Kaluba - Nokia Solutions and Networks Sp. z o.o.
Course - NVIDIA GPU Programming - Extended
Upcoming Courses
Related Courses
Developing AI Applications with Huawei Ascend and CANN
21 HoursThe Huawei Ascend series comprises AI processors engineered for high-performance inference and training operations.
This instructor-led, live training session, available online or in-person, is designed for intermediate-level AI engineers and data scientists seeking to develop and optimize neural network models utilizing Huawei’s Ascend platform and the CANN toolkit. This curriculum is tailored for government agencies requiring advanced AI infrastructure expertise.
Upon completion of this training, participants will be equipped to:
- Establish and configure the CANN development environment.
- Develop AI applications through MindSpore and CloudMatrix workflows.
- Enhance performance on Ascend NPUs by implementing custom operators and tiling techniques.
- Deploy models to edge or cloud environments for government use cases.
Course Format
- Interactive lectures and facilitated discussions.
- Hands-on application of Huawei Ascend and the CANN toolkit within sample applications.
- Guided exercises emphasizing model construction, training, and deployment.
Course Customization Options
- To request a customized training program aligned with specific infrastructure or dataset requirements, please contact us to arrange a consultation for government stakeholders.
Deploying AI Models with CANN and Ascend AI Processors
14 HoursAI Inference and Deployment with CloudMatrix
21 HoursCloudMatrix serves as a unified platform for AI development and deployment, engineered to support scalable, production-grade inference pipelines for government use cases.
This live training, delivered online or onsite, is designed for professionals with beginner to intermediate experience who intend to deploy and monitor AI models using CloudMatrix, with integration of CANN and MindSpore.
Upon completion, participants will be equipped to:
- Leverage CloudMatrix for model packaging, deployment, and service delivery.
- Convert and optimize models for compatibility with Ascend chipsets.
- Configure pipelines for both real-time and batch inference operations.
- Monitor deployments and optimize performance in production environments.
Course Structure
- Interactive instruction and collaborative discussion.
- Practical application of CloudMatrix through real-world deployment scenarios.
- Structured exercises emphasizing conversion, optimization, and scalability.
Customization Options
- For tailored training aligned with specific AI infrastructure or cloud environments, please contact the relevant authority for arrangements.
GPU Programming on Biren AI Accelerators
21 HoursBiren AI Accelerators are high-performance GPU systems engineered for artificial intelligence and high-performance computing workloads, supporting extensive model training and inference tasks.
This instructor-led training program, available in online or onsite formats, is designed for developers with intermediate to advanced expertise. It focuses on programming and optimizing applications using Biren’s proprietary GPU stack, incorporating practical comparisons to CUDA-based environments.
Upon completion of this training, participants will be equipped to:
- Comprehend Biren GPU architecture and memory hierarchy structures.
- Configure development environments and leverage Biren’s programming model.
- Translate and optimize CUDA-style code for Biren platforms.
- Implement performance tuning and diagnostic techniques.
Course Delivery Format
- Interactive lectures and facilitated discussions.
- Hands-on implementation of Biren SDK within sample GPU workloads.
- Structured exercises emphasizing code migration and performance tuning.
Customization Options for Government and Institutional Use
- To request tailored training content for government agencies or specific integration needs, please contact our coordination office.
Cambricon MLU Development with BANGPy and Neuware
21 HoursCambricon Machine Learning Units (MLUs) represent specialized artificial intelligence hardware engineered for optimized inference and training workloads in both edge and data center environments.
This instructor-led, live training program, available in online or on-site formats, is designed for intermediate-level developers seeking to build and deploy artificial intelligence models using the BANGPy framework and Neuware SDK on Cambricon MLU hardware.
Upon completion of this training, participants will be able to:
- Establish and configure BANGPy and Neuware development environments.
- Develop and optimize Python- and C++-based models for Cambricon MLUs.
- Deploy models to edge and data center devices utilizing the Neuware runtime.
- Integrate machine learning workflows with MLU-specific acceleration features.
Instructional Methodology
- Interactive lectures and facilitated discussions.
- Hands-on application of BANGPy and Neuware for development and deployment tasks.
- Structured exercises emphasizing optimization, integration, and system testing.
Customization Opportunities for Government and Enterprise Entities
- Organizations seeking a customized training curriculum tailored to specific Cambricon device models or operational use cases are encouraged to contact us for coordination.
Introduction to CANN for AI Framework Developers
7 HoursCANN (Compute Architecture for Neural Networks) constitutes Huawei’s artificial intelligence computing toolkit, designed to compile, optimize, and deploy AI models on Ascend AI processors for government and public sector applications.
This instructor-led, live training session (available online or onsite) is designed for entry-level AI developers seeking to comprehend the integration of CANN within the model lifecycle, from training through to deployment, and its interoperability with frameworks such as MindSpore, TensorFlow, and PyTorch.
Upon completion of this training, participants will possess the capability to:
- Comprehend the objectives and architectural design of the CANN toolkit.
- Establish a development environment incorporating CANN and MindSpore.
- Convert and deploy basic AI models onto Ascend hardware.
- Acquire foundational knowledge supporting future CANN optimization and integration projects.
Instructional Methodology
- Interactive lectures and facilitated discussions.
- Practical laboratory exercises involving simple model deployment.
- Detailed walkthrough of the CANN toolchain and integration points.
Customization Options for the Course
- To request a tailored training program for this course, please contact the designated office to arrange suitable provisions.
CANN for Edge AI Deployment
14 HoursHuawei’s Ascend CANN toolkit facilitates robust AI inference capabilities on edge devices, including the Ascend 310. CANN provides critical tools for compiling, optimizing, and deploying models in environments with restricted compute and memory resources, supporting operational efficiency for government applications.
This instructor-led live training, available online or onsite, is designed for intermediate-level AI developers and integrators tasked with deploying and optimizing models on Ascend edge devices using the CANN toolchain.
Upon completion of this training, participants will be equipped to:
- Prepare and convert AI models for the Ascend 310 platform using CANN tools.
- Develop lightweight inference pipelines utilizing MindSpore Lite and AscendCL.
- Optimize model performance in environments with limited compute and memory capacities.
- Deploy and monitor AI applications in practical edge scenarios relevant to public sector operations.
Course Delivery Format
- Interactive lectures accompanied by technical demonstrations.
- Hands-on laboratory exercises focused on edge-specific models and operational scenarios.
- Live deployment examples executed on virtual or physical edge hardware.
Customization Options for Course Content
- To request tailored training materials for this course, please contact our team to discuss specific requirements.
Understanding Huawei’s AI Compute Stack: From CANN to MindSpore
14 HoursHuawei's AI infrastructure, ranging from the foundational CANN SDK to the advanced MindSpore framework, provides a cohesive environment for AI development and deployment, specifically optimized for Ascend hardware performance.
This instructor-led training session, available in online or on-site formats, is designed for technical professionals at the beginner to intermediate level who seek to understand the interoperability of CANN and MindSpore components in supporting AI lifecycle management and infrastructure decision-making for government and other sectors.
Upon completion of this training, participants will be equipped to:
- Comprehend the hierarchical architecture of Huawei's AI computing stack.
- Recognize the role of CANN in enabling model optimization and hardware-level execution.
- Assess the MindSpore framework and associated toolchain in comparison to industry-standard alternatives.
- Evaluate the placement of Huawei's AI stack within enterprise or hybrid cloud/on-premises environments.
Instructional Format
- Interactive lectures and facilitated discussions.
Customization Options for the Course
- To initiate a customized training program tailored for government or specific organizational needs, please establish contact for scheduling arrangements.
Optimizing Neural Network Performance with CANN SDK
14 HoursThe CANN SDK (Compute Architecture for Neural Networks) serves as Huawei’s foundational AI computing platform, enabling developers to calibrate and enhance the operational efficiency of neural networks deployed on Ascend AI processors.
This instructor-led, live instruction (available online or on-site) is designed for senior AI developers and systems engineers seeking to refine inference capabilities through CANN’s advanced toolset, including the Graph Engine, TIK, and custom operator creation.
Upon completion of this training, participants will be equipped to:
- Comprehend the CANN runtime structure and its performance lifecycle.
- Employ profiling instruments and the Graph Engine for performance evaluation and refinement.
- Develop and optimize proprietary operators utilizing TIK and TVM.
- Address memory constraints and augment model throughput for government applications.
Instructional Methodology
- Interactive presentations and facilitated discussions.
- Practical laboratories incorporating real-time profiling and operator calibration.
- Refinement exercises utilizing edge-case deployment scenarios for government sectors.
Instructional Adaptation Options
- To request a customized training curriculum for this module, please contact the provider for coordination.
CANN SDK for Computer Vision and NLP Pipelines
14 HoursThe Compute Architecture for Neural Networks (CANN) Software Development Kit offers robust mechanisms for the deployment and optimization of real-time artificial intelligence applications in computer vision and natural language processing, particularly on Huawei Ascend infrastructure.
This instructor-led, live training course, available in online or on-site formats, is designed for intermediate-level AI practitioners seeking to build, deploy, and optimize vision and language models using the CANN SDK for production use cases for government.
Upon completion of this training, participants will be equipped to:
- Deploy and optimize CV and NLP models using CANN and AscendCL.
- Leverage CANN tools to convert models and integrate them into live operational pipelines.
- Enhance inference performance for tasks such as detection, classification, and sentiment analysis.
- Construct real-time CV/NLP pipelines suitable for edge or cloud-based deployment scenarios for government.
Course Format
- Interactive lectures and technical demonstrations.
- Practical laboratory exercises focused on model deployment and performance profiling.
- Design of live pipelines utilizing authentic CV and NLP use cases.
Customization Options
- To request tailored training aligned with specific operational needs for government, please contact the program office to arrange.
Building Custom AI Operators with CANN TIK and TVM
14 HoursCANN TIK (Tensor Instruction Kernel) and Apache TVM facilitate the advanced optimization and customization of AI model operators for Huawei Ascend hardware.
This instructor-led, live training (available online or onsite) is designed for advanced system developers seeking to build, deploy, and tune custom operators for AI models using CANN’s TIK programming model and TVM compiler integration.
Upon completion of this training, participants will be able to:
- Develop and test custom AI operators using the TIK DSL for Ascend processors.
- Integrate custom operators into the CANN runtime and execution graph.
- Leverage TVM for operator scheduling, auto-tuning, and benchmarking.
- Debug and optimize instruction-level performance for custom computation patterns.
Format of the Course
- Interactive instruction and practical demonstration.
- Hands-on coding of operators using TIK and TVM pipelines.
- Testing and tuning on Ascend hardware or simulation environments.
Course Customization Options
- To request a customized training for government, please contact us to arrange details.
Migrating CUDA Applications to Chinese GPU Architectures
21 HoursChinese GPU architectures, including Huawei Ascend, Biren, and Cambricon MLUs, provide viable CUDA alternatives designed for local AI and high-performance computing markets.
This instructor-led, live training program (available online or on-site) is intended for advanced GPU developers and infrastructure specialists seeking to migrate and optimize existing CUDA applications for deployment on Chinese hardware platforms for government use.
Upon completion of this training, participants will be equipped to:
- Assess the compatibility of existing CUDA workloads with domestic chip alternatives.
- Execute the porting of CUDA codebases to Huawei CANN, Biren SDK, and Cambricon BANGPy environments.
- Analyze performance metrics and identify critical optimization opportunities across different platforms.
- Resolve operational challenges associated with cross-architecture support and secure deployment.
Course Delivery Format
- Interactive instruction facilitated by structured discussions.
- Practical laboratory sessions focused on code translation and performance benchmarking.
- Supervised exercises emphasizing multi-GPU adaptation and integration strategies.
Customization Options
- To request a tailored training program aligned with specific platform requirements or CUDA projects, please contact the provider to coordinate arrangements.
Performance Optimization on Ascend, Biren, and Cambricon
21 HoursAscend, Biren, and Cambricon represent premier AI hardware platforms in China, each providing distinct acceleration and profiling capabilities for production-scale AI workloads.
This instructor-led, live training, available online or onsite, is designed for advanced AI infrastructure and performance engineers seeking to optimize model inference and training workflows across multiple Chinese AI chip platforms.
Upon completion of this training, participants will be able to:
- Conduct comprehensive benchmarking of models on Ascend, Biren, and Cambricon platforms.
- Identify system bottlenecks and inefficiencies in memory and compute resources.
- Apply optimization strategies at the graph, kernel, and operator levels.
- Tune deployment pipelines to enhance throughput and reduce latency for government operations.
Course Delivery Format
- Interactive lectures facilitated by expert discussion.
- Hands-on application of profiling and optimization tools specific to each platform.
- Guided exercises emphasizing practical tuning scenarios relevant to public sector needs.
Customization Opportunities
- To arrange a customized training session tailored to your specific performance environment or model type, please contact us to establish a schedule.