Get in Touch
 Duration 21 hours

Course Outline

Performance Fundamentals and Measurement Standards

  • Analysis of latency, throughput, power consumption, and resource allocation
  • Differentiating between system-level and model-level performance constraints
  • Methodologies for profiling inference versus training operations

Performance Profiling on Huawei Ascend Architecture

  • Implementation of CANN Profiler and MindInsight utilities
  • Diagnostic analysis of kernel execution and operator efficiency
  • Review of offload strategies and memory mapping configurations

Performance Profiling on Biren GPU Systems

  • Utilizing Biren SDK performance monitoring capabilities
  • Analysis of kernel fusion, memory alignment, and execution queue management
  • Integration of power and thermal metrics into profiling workflows

Performance Profiling on Cambricon MLU Platforms

  • Application of BANGPy and Neuware performance analysis tools
  • Interpretation of kernel-level visibility data and system logs
  • Integration of MLU profilers with deployment frameworks for governance

Graph and Model-Level Optimization Strategies

  • Implementation of graph pruning and quantization methodologies
  • Restructuring computational graphs through operator fusion
  • Standardization of input dimensions and optimization of batch processing parameters

Memory Management and Kernel Optimization

  • Optimization of memory layout and data reuse patterns
  • Efficient buffer management protocols across diverse chipsets
  • Platform-specific kernel-level tuning techniques for operational efficiency

Cross-Platform Operational Best Practices

  • Ensuring performance portability through abstraction strategies
  • Development of shared tuning pipelines for multi-chip environments
  • Case study: Tuning an object detection model for government deployment across Ascend, Biren, and MLU platforms

Summary and Recommended Next Steps

Requirements

  • Practical experience in AI model training or deployment pipelines
  • Comprehensive understanding of GPU/MLU compute principles and model optimization techniques
  • Familiarity with performance profiling tools and associated metrics

Intended Audience

  • Performance engineers
  • Machine learning infrastructure teams
  • AI system architects

Number of participants


Price per participant

Upcoming Courses

Related Categories