| Course Outline | General Information | Study Material | Lectures (classwise) |
The course consists of 4 lecture hours per week.
The basic thrust of the course would be to study approximation algorithms and randomization techniques in computer science and discrete mathematics.
We will try to stick to the basic course outline as given in this page.
We would assume in this course that you have undergone the Data and File Structures, Design and Analysis of Algorithms and Discrete Structures courses and have some knowledge of elementary discrete probability.
| Taught by: Arjit Bishnu (ArB) |
Class Timings: | Tuesday 14:15-16:00, Thursday 14:15-16:00 NAB-I or ACMU Seminar room Room |
| The necessary evil - marks, exam, etc.: | Mid-sem: 20, End-sem: 50, Internal evaluation: 30 |
| Books |
(B1) Algorithm Design J. Kleinberg and Eva Tardos Pearson Education (B2) Probability and Computing: Randomized Algorithms and Probabilistic Analysis Michael Mitzenmacher and Eli Upfal Cambridge (B3) Randomized Algorithms Rajeev Motwani and Prabhakar Raghavan Cambridge (B4) Computational Geometry: Algorithms and Applications Mark de Berg, Otfried Cheong, Marc van Kreveld, Mark Overmars Springer Verlag (B5) Computational Geometry: An Introduction Through Randomized Algorithms Ketan Mulmuley Prentice Hall (B6) The Probabilistic Method Noga Alon, Joel H. Spencer 4th edition, Wiley (B7) Geometric Approximation Algorithms Sariel Har-Peled American Mathematical Society (B8) Probabilistic Methods for Algorithmic Discrete Mathematics M. Habib, C. McDiarmid, J. Ramirez-Alfonsin, B. Reed (eds.) Springer (B9) Proofs from THE BOOK Martin Aigner, Günter M. Ziegler Springer, 3rd edition (B10) Markov Chains and Mixing Times David Asher Levin, Yuval Peres, and Elizabeth Lee Wilmer American Mathematical Society (AMS) A draft of the book can be found here. (B11) Lectures on Discrete Geometry Jiri Matousek Springer (B12) Geometric Discrepancy Jiri Matousek Springer (B13) Computational Complexity: A Modern Approach Sanjeev Arora and Boaz Barak Cambridge University Pressa (B14) Stochastic Processes Sheldon Ross Wiley Student Edition (B15) Approximation Algorithms Vijay V. Vazirani Springer (B16) The Design of Approximation Algorithms David P. Williamson and David B. Shmoys Cambridge University Press |
| Web Resources |
(W1) Lecture Notes by Sariel Har Peled
(W2) Lecture Notes by David Mount (W3) Chapter on Random Graphs (Hopcroft and Kannan's draft) (W4) Lecture notes by Tim Roughgarden (W5) Probabilistic Combinatorics by Thomas Rothvoss (W6) Richard Weber's course on Probability for first year mathematicians at Cambridge (W7) The course web-page on Markov Chains by Richard Weber is here. The notes on Markov Chains are here. (W8) The Probabilistic Method Lecture Notes by J. Matousek and J. Vondrak |
| LECTURE DATES | TOPICS | EXERCISE |
| Lecture 1 (09-01-24) |
Introduction to the course;
Polynomial reductions and NP-Complete problems --
Read the subsection on NP-Complete problems in (B1);
Introduction to approximation algorithms and a 2-factor approximation algorithm for vertex cover --
Read from (B15) and (B16) |
-- |
| Lecture 2 (11-01-24) |
A 2- and 3/2-factor approximation for metric TSP; |
-- |
| Lecture 3 (18-01-24) |
An FPTAS for Knapsack --
Read from (B15)
Introduction to LP and a deterministic LP rounding for a f-factor approximation of Set Cover --
Read from (B16) |
-- |
| Lecture 4 (22-01-24) |
Max-SAT and its approximation: an application of first moment method --
Read Section 1.1 in (B8); or (W4); or Section 13.4 in (B1)
Conditional probability and graph min-cut --
Read the subsection on global mincut in (B1); or (B2)
Randomized quicksort --
Read from (B2) |
-- |
| Lecture 5 (23-01-24) |
Concentration inequalities: Markov and Chebyshev --
Read "Five essential tools for the Analysis of Randomized Algorithms" from (W4)'s "a Second Course in Algorithms"; and Chapter 3 in (B2)
Chernoff bounds
Read Chapter 4 in (B2) |
-- |
| Lecture 6 (25-01-24) |
Chernoff bounds (contd.)
Read "Five essential tools for the Analysis of Randomized Algorithms" from (W4)'s "a Second Course in Algorithms"; and Chapter 4 in (B2)
Chernoff bounds applied to Balls and bins; load balancing --
Read (B1) and Chapter 4 in (B2) |
-- |
| Lecture 7 (29-01-24) |
Packet routing -- high probability bounds using Chernoff bounds
Read from (B2)
Quicksort -- high probability bounds using Chernoff bounds
Read from handout given in the class |
-- |
| Lecture 8 (30-01-24) |
Randomized incremental construction and backward analysis in computational geometry: LP in fixed dimensions and minimum enclosing disk --- |
-- |
| Lecture 9 (06-02-24) |
Probabilistic Methods: Ramsey Numbers, Erdős-Ko-Rado Theorem, Hamiltonian paths, |
|
| Lecture 10 (19-02-24) |
Trapezoidal decomposition and point location |
|
| Lecture 11 (20-02-24) |
Trapezoidal decomposition and point location (contd.): |
|
| Lecture 12 (22-02-24) |
Lovasz Local Lemma: |
|
| Lecture 13 (05-03-24) |
Lovasz Local Lemma and its applications: edge disjoint paths, list coloring, asymmetric LLL
Read from (B2), (B6) or (W5)
Constructive Lovasz Local Lemma:
Read from "Miscellaneous Lecture Notes" of (W4) |
|
| Lecture 14 (20-03-24) |
Constructive Lovasz Local Lemma:
Read from "Miscellaneous Lecture Notes" of (W4) and handout |
|
| Lecture 15 (21-03-24) |
Random graphs: degree distribution, existence of triangles, phase transition, isolated vertices. |
|
| Lecture 16 (26-03-24) |
Martingales, Doob Martingales, Stopping Times, Wald's equation |
- |
| Lecture 17 (27-03-24) |
Martingales: Lipschitz condition and Azuma Hoeffding inequalities; applications |
- |
| Lecture 18 (28-03-24) |
General form of Azuma Hoeffding inequalities; more applications |
- |
| Lecture 19 (02-04-24) |
Range spaces and VC dimension: |
- |
| Lecture 20 (04-04-24) |
LP duality: Weak and strong duality, complementary slackness |
- |
| Lecture 21 (09-04-24) |
VC dimension and epsilon-nets: epsilon-net theorem |
- |
| Lecture 22 (12-04-24) |
Role of LP duality in approximation -- Set cover; Feedback Vertex Set |
- |
| Lecture 23 (13-04-24) |
Randomized rounding for approximation |
- |
| Lecture 24 (16-04-24) |
k-centre problem: inapproximability result using dominating set |
- |
| Lecture 25 (18-04-24) |
Derandomization using conditional expectation |
- |
| Lecture 26 (19-04-24) |
Randomized lower bounds, Yao's minimax principle |
- |