Get in Touch

Course Outline

Overview of Huawei CloudMatrix

  • CloudMatrix architecture and deployment workflow
  • Compatible model types, formats, and operational modes
  • Common applications and supported hardware accelerators

Preparing Models for Deployment

  • Exporting models from training frameworks (MindSpore, TensorFlow, PyTorch)
  • Utilizing the Ascend Tensor Compiler (ATC) for format conversion
  • Differentiating between static and dynamic input shapes

Deploying to CloudMatrix

  • Creating services and registering model assets
  • Deploying inference endpoints via graphical interface or command-line interface
  • Configuring traffic routing, authentication, and access controls for government systems

Serving Inference Requests

  • Executing batch versus real-time inference operations
  • Managing data preprocessing and postprocessing pipelines
  • Integrating CloudMatrix services with external applications

Monitoring and Performance Optimization

  • Reviewing deployment logs and tracking request metrics
  • Managing resource scaling and load balancing strategies
  • Optimizing latency and maximizing throughput efficiency

Integration with Enterprise Tools

  • Connecting CloudMatrix with Object Storage Service (OBS) and ModelArts
  • Implementing workflow automation and model version control
  • Establishing CI/CD pipelines for model deployment and rollback procedures

End-to-End Inference Pipeline

  • Deploying a complete image classification workflow
  • Conducting benchmark tests and validating model accuracy
  • Simulating system failover scenarios and alert protocols

Summary and Next Steps

Requirements

  • Proficiency in artificial intelligence model training procedures
  • Practical experience utilizing Python-based machine learning frameworks
  • Foundational knowledge of cloud deployment architectures

Audience

  • AI operations personnel
  • Machine learning engineering staff
  • Cloud deployment specialists engaged with Huawei infrastructure for government initiatives
 21 Hours

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories