Get in Touch

Course Outline

Introduction to Edge AI and the Ascend 310

  • Overview of Edge AI: trends, constraints, and applications
  • Huawei Ascend 310 chip architecture and supported toolchain
  • The role of CANN within the edge AI deployment stack

Model Preparation and Conversion

  • Exporting trained models from TensorFlow, PyTorch, and MindSpore
  • Using ATC to convert models to the OM format for Ascend devices
  • Addressing unsupported operations and employing lightweight conversion strategies

Developing Inference Pipelines with AscendCL

  • Utilizing the AscendCL API to run OM models on the Ascend 310
  • Input/output preprocessing, memory management, and device control
  • Deploying within embedded containers or lightweight runtime environments

Optimization for Edge Constraints

  • Reducing model size and tuning precision (FP16, INT8)
  • Using the CANN profiler to identify bottlenecks
  • Managing memory layout and data streaming for enhanced performance

Deploying with MindSpore Lite

  • Using the MindSpore Lite runtime for mobile and embedded targets
  • Comparing MindSpore Lite with raw AscendCL pipelines
  • Packaging inference models for device-specific deployment

Edge Deployment Scenarios and Case Studies

  • Case study: smart camera with object detection models on the Ascend 310
  • Case study: real-time classification in an IoT sensor hub
  • Monitoring and updating deployed models at the edge

Summary and Next Steps

Requirements

  • Experience with AI model development or deployment workflows
  • Basic understanding of embedded systems, Linux, and Python
  • Familiarity with deep learning frameworks such as TensorFlow or PyTorch

Audience

  • IoT solution developers
  • Embedded AI engineers
  • Edge system integrators and AI deployment specialists
 14 Hours

Number of participants


Price per participant

Testimonials (1)

Upcoming Courses

Related Categories