Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 14 hours
Course Outline
Introduction to AI Inference with Docker
- Understanding AI inference workloads
- Benefits of containerized inference
- Deployment scenarios and constraints
Building AI Inference Containers
- Selecting base images and frameworks
- Packaging pretrained models
- Structuring inference code for container execution
Securing Containerized AI Services
- Minimizing the container attack surface
- Managing secrets and sensitive files
- Strategies for safe networking and API exposure
Portable Deployment Techniques
- Optimizing images for portability
- Ensuring predictable runtime environments
- Managing dependencies across platforms
Local Deployment and Testing
- Running services locally using Docker
- Debugging inference containers
- Testing performance and reliability
Deploying on Servers and Cloud VMs
- Adapting containers for remote environments
- Configuring secure server access
- Deploying inference APIs on cloud virtual machines
Using Docker Compose for Multi-Service AI Systems
- Orchestrating inference alongside supporting components
- Managing environment variables and configurations
- Scaling microservices with Compose
Monitoring and Maintenance of AI Inference Services
- Approaches to logging and observability
- Detecting failures in inference pipelines
- Updating and versioning models in production
Summary and Next Steps
Requirements
- A foundational understanding of machine learning concepts
- Experience with Python or backend development
- Familiarity with core containerization concepts
Target Audience
- Software Developers
- Backend Engineers
- Teams responsible for deploying AI services
Testimonials (2)
As i said before , for a person like me (no exp. ) this was a gateway to understanding features and functions with these programs/tools & etc. .
Patrick V. Duylovski - UBB + DZI (KBC GROUP)
Course - Docker and Kubernetes
multi-tiered, structured course programme.
