Machine learning models are powerful, but do you know they are also vunerable to different attacks? In this course we will start from privacy attacks to different machine learning models. We will then talk about defenses such as differential privacy. Finally we will discuss other privacy enhancing technologies. While the course is a 4-level course (we will also have a semester-long project and we assume you know basic concepts within computer science), junior students are welcome to take the challenge (we will go slowly and provide references so if you are not familiar with some concepts, you can catch up)! Prerequisites only include basic knowledge of coding (Python), algorithms, and probability.

  • Instructor: Tianhao Wang
  • Location: Mechanical Engr Bldg 341
  • Time: MoWe 3:30pm - 4:45pm
  • TA: TBD
  • Discussion: TBD
  • Office Hour
    • Tianhao: TBD and by appointment
    • TA: TBD and by appointment

Format:

  • Each lecture will involve reading one or more papers. Students will also be required to present at least one reading during the semester.
  • Students will be evaluated based on class performance and a research project. Projects can focus on developing new theory/algorithms, or on implementing/adapting known algorithms to a real application setting.

Grading (tentative, subject to change):

  • Three assignments (60%, 20% each) on (1) privacy attacks towards machine learning, (2) differential privacy (dp for short), and (3) secure multi-party computation. Theory (proofs) and practice (programming in python) will be covered in each assignment.
  • Project (group of 2: 40%). Teams can utilize office hours to get feedbacks on the project.

Topics

  1. week 1-3: privacy issues in machine learning
    • privacy attacks and basic defenses to deep learning models
      • including preliminaries of machine learning, nlp, graph neural networks, GANs, self-supervise learning, and federated learning)
      • covering membership inference attack, attribute inference attack, property inference attack, reconstruction attack
    • machine unlearning
    • potential privacy risks in model explanation
    • auditing/monitoring privacy issues of machine learning
  2. week 4-7: differential privacy (dp, the standard way for protecting privacy)
    • earlier works of k-anonymity, l-diversity and t-closeness and their limitations
    • basics of dp (definitions, compositions)
    • primitives for satisfying dp
      • Laplace mechanism, Exponential mechanism, Report-noisy-max, SVT, Gaussian mechanism
    • advanced composition
      • strong composition, renyi dp
    • applications: hierarchical method
    • applications: marginals and generative models (privsyn and privtrace)
    • applications: graph
    • applications: ml (dpsgd, nlp, fine-tuning)
  3. week 8-10: other flavors of dp
    • local dp
    • shuffle dp
    • relaxed definition of dp
      • geo-indistinguishability, event-level, w-window, pufferfish, one-sided dp, label dp
    • interaction of dp with other domains, such as fairness, usability, explanabilities
    • safe implementation of dp (and floating-point attacks to dp)
  4. week 11-14: privacy enhancing technologies
    • prelims of crypto: encryption, hash, message authentication, public-key encryption
    • secure multi-party computation (including review of some libraries)
    • secure multi-party computation and machine learning (libraries like aby)
    • secure multi-party computation and dp (compare with shuffle dp, honeycrisp, etc)
    • homomorphic encryption (crypte)
    • zero-knowledge proofs
    • encrypted databases
    • oblivious RAM
    • Tor
    • secure hardware
    • quantum computer

Schedule (tentative, subject to change), we will meet in a hybrid format (both in-person and using zoom)

Week Dates Monday Wednesday
1 Aug 22 - Aug 26 No Class  
2 Aug 29 - Sep 2    
3 Sep 5 - Sep 9    
4 Sep 12 - Sep 16    
5 Sep 19 - Sep 23    
6 Sep 26 - Sep 30    
7 Oct 3 - Oct 7    
8 Oct 10 - Oct 14    
9 Oct 17 - Oct 21    
10 Oct 24 - Oct 28    
11 Oct 31 - Nov 4    
12 Nov 7 - Nov 11    
13 Nov 14 - Nov 18    
14 Nov 21 - Nov 25   Thanksgiving
15 Nov 28 - Dec 2    
16 Dec 5 - Dec 9 Last Class