Course Outline
Introduction to AI Threat Modeling
- What makes AI systems vulnerable?
- AI attack surface compared to traditional systems
- Key attack vectors: data, model, output, and interface layers
Adversarial Attacks on AI Models
- Understanding adversarial examples and perturbation techniques
- White-box vs black-box attacks
- FGSM, PGD, and DeepFool methods
- Visualizing and crafting adversarial samples
Model Inversion and Privacy Leakage
- Inferring training data from model output
- Membership inference attacks
- Privacy risks in classification and generative models
Data Poisoning and Backdoor Injections
- How poisoned data influences model behavior
- Trigger-based backdoors and Trojan attacks
- Detection and sanitization strategies
Robustness and Defense Techniques
- Adversarial training and data augmentation
- Gradient masking and input preprocessing
- Model smoothing and regularization techniques
Privacy-Preserving AI Defenses
- Introduction to differential privacy
- Noise injection and privacy budgets
- Federated learning and secure aggregation
AI Security in Practice
- Threat-aware model evaluation and deployment
- Using ART (Adversarial Robustness Toolbox) in applied settings
- Industry case studies: real-world breaches and mitigations
Summary and Next Steps
Requirements
- A solid understanding of machine learning workflows and model training processes
- Experience with Python and common ML frameworks such as PyTorch or TensorFlow
- Familiarity with basic security or threat modeling concepts is beneficial
Target Audience
- Machine learning engineers
- Cybersecurity analysts
- AI researchers and model validation teams
Testimonials (2)
I really enjoyed learning about AI attacks and the tools out there to begin practicing and actively using for security testing. I took a lot of knowledge away which I didn't have at the beginning and the course met what I hoped it would be. My favorite part shown from the training was Comet Browser and was amazed at what it could do. Definitely something will be looking into more. Overall it was a great course and enjoyed learning all OWASP GenAI Top 10.
Patrick Collins - Optum
Course - OWASP GenAI Security
The profesional knolage and the way how he presented it before us
