Madhu Sudan: 6.841/18.405J: Advanced Complexity Theory
General Info
- Lecturer: Madhu Sudan; 32-G640; email: first name at mit dot edu
- TA: Brendan Juba; 32-G636; email: bjuba at mit dot edu; Office Hours: TBA
- Units: 3-0-9 H Level Grad Credit;
- Time and Location: MW 11-12:30 in 26-322
Announcements
- Please fill out HKN Survey (even if you are only a listener).
- Scribe availability (Sample files for scribes: sample.tex; Uses: preamble.tex and fullpage.sty)
Course announcement
Prereq: 6.840J/18.404J
Time: MW 11-12:30
Location: 26-322
3-0-9 H-Level Grad Credit
Homepage: http://courses.csail.mit.edu/6.841
Advanced Complexity Theory
This course is a follow-up to Introduction to the theory of computation (6.840). It covers advanced topics in computational complexity, leading up to the state-of-the-art in the field. Principal topics include:
- Review of time and space complexity.
- Non-determinism and alternation.
- Non-uniform models of computation and lower bounds.
- Interaction, proof, and knowledge.
- Probabilistically checkable proofs and inapproximability.
- Quantum computation.
A tentative list of topics is available from the course website (http://courses.csail.mit.edu/6.841).
Lecture notes for this course from previous semesters give further details on the material covered. These may be found at
http://people.csail.mit.edu/madhu/ST02, http://people.csail.mit.edu/madhu/ST03, http://people.csail.mit.edu/madhu/ST05, and http://people.csail.mit.edu/madhu/ST07.
Instructor: Madhu Sudan TA: Brendan Juba
Grading Policy
Grades will be based on a combination of the following ingredient
- 2-4 Problem Sets.
- A course project (instructions to be posted shortly).
- Class Participation (biased towards the second half of the term).
- Additionally, you must scribe at least one lecture.
Instructions
Instructions for working on and turning in problem sets
- Collaboration is allowed and encouraged. You are allowed to read any material, but it will be counterproductive to your interests to run to Google to search for solutions to the problems. Better to think on your own, and seek references only for hints or to improve your understanding of the material.
- No matter how you solve the problems, you must write your solutions on your own and you must cite all sources (collaborators and other references).
- Turn in your problem sets electronically by email to bjuba at mit dot edu. You can write your solutions in any format you choose, but submit as pdf or plain text.
- Deadlines are for 10pm on the due date.
Project Topics
Potential Project Topics for Advanced Complexity Theory (MIT 6.841/18.405; Spring 2009):
- A Switching Lemma Primer (by Paul Beame). Project unassigned.
- Circuit Complexity and Communication Complexity (by Ran Raz). Project unassigned.
- Communication lower bounds using dual polynomials (by Alexander Sherstov). Project unassigned.
- Alternation-Trading Proofs, Linear Programming, and Lower Bounds (by Ryan Williams); or A Survey of Lower Bounds for Satisfiability and Related Problems (by Dieter van Melkebeek). Project assigned (Rotem O. & Jean Y.)
- A Generic Time Hierarchy for Semantic Models With One Bit of Advice (by Dieter van Melkebeek and Konstantin Pervyshev). Project Unassigned.
- The Complexity of Computing the Permanent. (by Leslie Valiant). Project unassigned.
- Arithmetization: A new method in structural complexity theory (by Laszlo Babai and Lance Fortnow). Project unassigned.
- The knowledge complexity of interactive proof systems (by S. Goldwasser, S. Micali, and C Rackoff). Project unassigned.
- Zero-Knowledge and Secure Computation (by O. Goldreich, S. Micali, and A. Wigderson). Project unassigned.
- A Complete Problem for Statistical Zero Knowledge (by Amit Sahai and Salil Vadhan). Project assigned. (Alex A. & Jessica Y.)
- The Shrinkage Exponent is 2 (by Johan Hastad). Project unassigned.
- Natural Proofs (by Alexander Razborov and Steven Rudich). Project unassigned.
- Constant-depth circuits, Fourier transform and learnability (by Nati Linial, Yishay Mansour and Noam Nisan). Project assigned (Huy N. & Vartika S.).
- (Polylogarithmic independence can fool DNF formulas (by Louay Bazzi) OR A simple proof of Bazzi’s theorem (by Alexander Razborov)) AND (Poly-logarithmic independence fools AC0 circuits (by Mark Braverman)). Project unassigned.
- Simple Analysis of graph tests for linearity and PCP (by Johan Hastad and Avi Wigderson). Project unassigned.
- The PCP Theorem by gap amplification (by Irit Dinur). Project assigned (Sam M. & Alessandro C.).
- New Lattice Based Cryptographic Constructions (by Oded Regev). Project unassigned.
- On Worst-Case to Average-Case Reductions for NP Problems (by Andrej Bogdanov and Luca Trevisan). Project unassigned.
- On the random-self-reducibility of complete sets (Joan Feigenbaum and Lance Fortnow). Project unassigned.
- Quantum circuit complexity (by Andrew Yao). Project unassigned.
- Exponential Separation of Quantum and Classical One-Way Communication Complexity (by Z. Bar-Yossef, T.S. Jayram, and I. Kerenidis). Project unassigned.
- Derandomized Squaring of Graphs (by Eyal Rozenman and Salil Vadhan). Project assigned (Paul C. & Rishi G.).
- Hardness amplification within NP (by Ryan O’Donnell). Project assigned (Asilata B. & Alex C.).
- Hardcore Distributions for Somewhat Hard Problems (by Russell Impagliazzo). Project assigned (Mergen N. & Colin Z.).
- Derandomizing Polynomial Identity Testing means Proving Circuit Lower Bounds (by Russell Impagliazzo and Valentine Kabanets). Project unassigned.
- Hardness vs. Randomness (by Noam Nisan and Avi Wigderson). Project assigned (David C. & Michael F.).
- Zero-Knowledge Proofs of Identity (by Amos Fiat, Uriel Feige, and Adi Shamir). Project assigned (Jeremy H. & Adam S.).
- Optimal Inapproximability Results for MAX-CUT and Other 2-Variable CSPs? (by Subhash Khot, Guy Kindler, Elchanan Mossel, Ryan O’Donnell). Project assigned (Debmalya P. & Yang C.)
Tentative list of Topics
- Lecture 01 (02/04): Introduction. Review of Complexity. Notes. Scribe notes (lect01.tex, lect01.pdf).
- Lecture 02 (02/09): Diagonalization and Relativization. Ladner’s theorem. Notes. Scribe notes (lect02.tex, lect02.pdf).
- Lecture 03 (02/11): Non-uniform complexity. Neciporuk’s Lower Bound for Formula Size. Notes. Scribe notes (lect03.tex, lect03.pdf).
- Monday 02/16: Presidents Day Holiday.
- Lecture 04 (02/17): MIT Virtual Monday! Barrington’s theorem. Notes. Scribe notes (lect04.tex, lect04.pdf).
- Lecture 05 (02/18): Parity is not in AC0 (Furst-Saxe-Sipser). Notes. Scribe notes (lect05.tex, lect05.pdf).
- Lecture 06 (02/23): Parity is not in AC0 (Razborov-Smolensky). Notes. Scribe notes (lect06.tex, lect06.pdf).
- Lecture 07 (02/25): Communication Complexity and Circuit lower bounds. Notes. Scribe notes (lect07.tex, lect07.pdf).
- Lecture 08 (03/02): Alternation: Time vs. Space. Fortnow’s theorem. Notes. Scribe notes (lect08.tex, lect08.pdf).
- Lecture 09 (03/04): Debates, Alternation, Polynomial Hierarchy, Karp-Lipton theorem. Notes. Scribe notes (lect09.tex, lect09.pdf).
- Lecture 10 (03/09): Randomness and computing. Algorithms, Models, Classes, Promise Problems. Notes. Scribe notes (lect10.tex, lect10.pdf).
- Lecture 11 (03/11): Properties of BPP: Amplification, Low circuit complexity, Containment in PH. Notes. Scribe notes (lect11.tex, lect11.pdf).
- Lecture 12 (03/16): Complexity of Unique Satisfiability. Counting Problems. Notes. Scribes notes (lect12.tex, lect12.pdf).
- Lecture 13 (03/18): Toda’s theorem: Alternation reduces to counting. Notes. Scribe notes (lect13.tex, lect13.pdf).
- 03/23 – 03/27: Spring Break!
- Lecture 14 (03/30): Interactive Proofs. AM, IP. Notes. Scribe notes (lect14.tex, lect14.pdf).
- Lecture 15 (04/01): IP vs. PSPACE. #P in IP. Notes. Scribe notes (lect15.tex, lect15.pdf).
- Lecture 16 (04/06): Straightline program with polynomials. IP=PSPACE. Notes. Scribe notes (lect16.tex, lect16.pdf).
- Lecture 17 (04/08): Knowledge, Statistical and Computational. Notes. Scribe notes (lect17.tex, lect17.pdf).
- Lecture 18 (04/13): Probabilistically checkable proofs. Statement of the PCP theorem. Approximation and Inapproximability. Scribe notes (lect18.tex, lect18.pdf).
- Lecture 19 (04/15): PCP – An exponentially long, O(1)-query, PCP for satisfiability. Notes. Scribe notes (lect19.tex, lect19.pdf).
- Monday 04/20: Patriots Day Holiday.
- Lecture 20 (04/22): PCP – Dinur’s proof of the PCP Theorem (most of it). Notes. Scribe notes (lect20.tex, lect20.pdf).
- Lecture 21 (04/27): Guest lecturer: Jakob Nordstrom: Proof Complexity. Notes (joint notes for Lectures 21 and 22): Scribe notes (lect21.tex, lect21.pdf).
- Lecture 22 (04/29): Guest lecturer: Jakob Nordstrom: Proof Complexity (contd.). Scribe notes (lect22.tex, lect22.pdf).
- Lecture 23 (05/04): Average case complexity. Notes. Scribe notes (lect23.tex, lect23.pdf).
- Lecture 24 (05/06): CANCELLED Due to Project Presentations
- Wednesday (05/06): 9am-12:00pm: Project Presentations in G531 (Signup info here).
- Thursday (05/07): 9am-12:30pm: Project Presentations in G631 (Signup info here)
- Lecture 25 (05/11): Pseudorandomness and Derandomization. Notes. Scribe notes (lect25.tex, lect25.pdf).
- Lecture 26 (05/13): Conclusions.
References
- Dan Spielman’s Lecture Notes from Spring 2001 http://www-math.mit.edu/~spielman/AdvComplexity/2001.
- Lecture Notes from Spring 2007 http://theory.lcs.mit.edu/~madhu/ST07. (Can also try …/ST02, …/ST03, …/ST05 for interim years’ notes.)
- Oded Goldreich: Computational Complexity: A Conceptual Perspective.
- Sanjeev Arora and Boaz Barak: Computational Complexity: A Modern Approach.
- Christos Papadimitriou: Computational Complexity.
- Michael Sipser: Introduction to the Theory of Computation (for initial lectures only).
Scribes
- Availability information here.
- Sample tex file, uses preamble.tex and fullpage.sty.