Course Outline
Introduction to AI Red Teaming for Government
- Understanding the AI Threat Landscape for Government
- Roles of Red Teams in AI Security for Government
- Ethical and Legal Considerations for Government
Adversarial Machine Learning for Government
- Types of Attacks: Evasion, Poisoning, Extraction, Inference
- Generating Adversarial Examples (e.g., FGSM, PGD)
- Targeted vs Untargeted Attacks and Success Metrics for Government
Testing Model Robustness for Government
- Evaluating Robustness Under Perturbations for Government
- Exploring Model Blind Spots and Failure Modes for Government
- Stress Testing Classification, Vision, and NLP Models for Government
Red Teaming AI Pipelines for Government
- Attack Surface of AI Pipelines: Data, Model, Deployment for Government
- Exploiting Insecure Model APIs and Endpoints for Government
- Reverse Engineering Model Behavior and Outputs for Government
Simulation and Tooling for Government
- Using the Adversarial Robustness Toolbox (ART) for Government
- Red Teaming with Tools like TextAttack and IBM ART for Government
- Sandboxing, Monitoring, and Observability Tools for Government
AI Red Team Strategy and Defense Collaboration for Government
- Developing Red Team Exercises and Goals for Government
- Communicating Findings to Blue Teams for Government
- Integrating Red Teaming into AI Risk Management for Government
Summary and Next Steps for Government
Requirements
- An understanding of machine learning and deep learning architectures for government applications.
- Experience with Python and ML frameworks, such as TensorFlow and PyTorch.
- Familiarity with cybersecurity concepts or offensive security techniques.
Audience
- Security researchers for government agencies.
- Offensive security teams within the public sector.
- AI assurance and red team professionals for government organizations.
Testimonials (2)
I really enjoyed learning about AI attacks and the tools out there to begin practicing and actively using for security testing. I took a lot of knowledge away which I didn't have at the beginning and the course met what I hoped it would be. My favorite part shown from the training was Comet Browser and was amazed at what it could do. Definitely something will be looking into more. Overall it was a great course and enjoyed learning all OWASP GenAI Top 10.
Patrick Collins - Optum
Course - OWASP GenAI Security
The profesional knolage and the way how he presented it before us