CS 6501 - Security of AI Systems Attacks and Defenses
| Spring 2026 | University of Virginia |
About This Course
This graduate-level course explores the security of large language models (LLMs), covering common attack vectors and defense strategies. Emphasis is on practical applications – students will analyze recent research from top venues and industry labs, understanding how adversaries exploit LLMs and how to mitigate these threats.
Quick Links
| Link | Description |
|---|---|
| 📅 Calendar | Weekly course topics and readings |
| 👥 Staff | Instructor and TA information |
| 📊 Grading | Course grading breakdown |
| 🎯 Course Project | Project timeline and requirements |
| 📜 Academic Policies | Honor code, accommodations, and policies |
| 📢 Announcements | Latest course updates |
📚 Course Topics
Attacks & Threats
- Week 1: Introduction to LLM Security and Threat Landscape
- Week 2: Adversarial Prompt Attacks (Prompt Injection & Jailbreaking)
- Week 3: Advanced Prompt-Based Attacks and Evasion Techniques
- Week 4: Data Poisoning and Training-Time Attacks
- Week 5: Privacy Attacks (Model Inversion & Membership Inference)
- Week 6: Model Extraction and Intellectual Property Theft
- Week 7: Red Teaming and Threat Modeling for LLMs
Defenses & Evaluation
- Week 8: Secure Fine-Tuning and RLHF
- Week 9: Defenses and Mitigations for LLMs
- Week 10: Robust Architectures and Safety Alignment Techniques
- Week 11: Evaluation and Benchmarking of LLM Security
Advanced Topics
- Week 12: Security Challenges in LLM-Based Systems
- Week 13: Supply Chain Security and Deployment Best Practices
- Week 14: Emerging Threats and Future Research Directions
👨🏫 Course Information
Instructor
- 📧 hassan@virginia.edu
- 🏢 Rice Hall 522
- 🕐 Office Hours: TBD
Teaching Assistant
TBD
- 📧 tbd@virginia.edu
- 🏢 Rice Hall 442
- 🕐 Office Hours: TBD
Logistics
Class Time: Tuesday & Thursday, 5:00 PM - 6:15 PM Location: TBD Prerequisites: No formal prerequisites. Background in computer security and operating systems (CS4630, CS4414) helpful.
Communication Channels
- 📝 Lecture Slides & Submissions: Collab
- 💬 Discussions & Announcements: Piazza
- 📋 Paper Signup Sheet: Google Sheet