| Course Outline | General Information | Study Material | Lectures (classwise) |
The course consists of 4 lecture hours per week.
The basic thrust of the course would be to study Randomization techniques in computer science and discrete mathematics.
We will try to stick to the basic course outline as given in this page.
We would assume in this course that you have undergone the Data and File Structures, Design and Analysis of Algorithms and Discrete Structures courses and have some knowledge of elementary discrete probability.
| Taught by: Arijit Ghosh (ArG) and Arjit Bishnu (ArB) |
Class Timings: | Monday 16:05-17:50, Friday 11:10-12:55 Room No. 709-710, S. N. Bose Bhavan (Library Building) |
| The necessary evil - marks, exam, etc.: | Mid-sem: 10, End-sem: 50, Internal evaluation: 40 |
| Books |
(B1) Algorithm Design J. Kleinberg and Eva Tardos Pearson Education (B2) Probability and Computing: Randomized Algorithms and Probabilistic Analysis Michael Mitzenmacher and Eli Upfal Cambridge (B3) Randomized Algorithms Rajeev Motwani and Prabhakar Raghavan Cambridge (B4) Computational Geometry: Algorithms and Applications Mark de Berg, Otfried Cheong, Marc van Kreveld, Mark Overmars Springer Verlag (B5) Computational Geometry: An Introduction Through Randomized Algorithms Ketan Mulmuley Prentice Hall (B6) The Probabilistic Method Noga Alon, Joel H. Spencer 4th edition, Wiley (B7) Geometric Approximation Algorithms Sariel Har-Peled American Mathematical Society (B8) Probabilistic Methods for Algorithmic Discrete Mathematics M. Habib, C. McDiarmid, J. Ramirez-Alfonsin, B. Reed (eds.) Springer (B9) Proofs from THE BOOK Martin Aigner, Günter M. Ziegler Springer, 3rd edition (B10) Markov Chains and Mixing Times David Asher Levin, Yuval Peres, and Elizabeth Lee Wilmer American Mathematical Society (AMS) A draft of the book can be found here. (B11) Lectures on Discrete Geometry Jiri Matousek Springer (B12) Geometric Discrepancy Jiri Matousek Springer (B13) Computational Complexity: A Modern Approach Sanjeev Arora and Boaz Barak Cambridge University Pressa (B14) Stochastic Processes Sheldon Ross Wiley Student Edition |
| Web Resources |
(W1) Lecture Notes by Sariel Har Peled
(W2) Lecture Notes by David Mount (W3) Chapter on Random Graphs (Hopcroft and Kannan's draft) (W4) Lecture notes by Tim Roughgarden (W5) Probabilistic Combinatorics by Thomas Rothvoss (W6) Richard Weber's course on Probability for first year mathematicians at Cambridge (W7) The course web-page on Markov Chains by Richard Weber is here. The notes on Markov Chains are here. (W8) The Probabilistic Method Lecture Notes by J. Matousek and J. Vondrak |
| LECTURE DATES (Taught by) | TOPICS | EXERCISE |
| Lecture 1 (ArB) (26-07-19) |
Max-SAT and its approximation: an application of first moment method --
Read Section 1.1 in (B8); or (W4); or Section 13.4 in (B1)
Conditional probability and graph min-cut --
Read the subsection on global mincut in (B1); or (B2)
Lower bound on crossing number: a proof using elementary probability --
Read from graph theory part of (B9) |
Exercise Sheet I |
| Lecture 2 (ArB) (29-07-19) |
Use of concentration inequalities Markov and Chebyshev with applications to hashing --
Read "Five essential tools for the Analysis of Randomized Algorithms" from (W4)'s "a Second Course in Algorithms"
Chernoff and union bound -- Load balancing
Read Section 13.10 on Load Balancing in (B1)
Packet Routing --
Read Section 13.11 on Packet Routing in (B1) |
Exercise Sheet II (updated on Aug 11) |
| Lecture 3 (ArG) (02-08-19) |
Probabilistic Methods: |
Exercise Sheet III |
| Lecture 4 (ArG) (05-08-19) |
Probabilistic Methods: |
|
| Lecture 5 (ArB) (Extra class) (08-08-19) |
Chernoff and union bound: |
|
| Lecture 6 (ArB) (09-08-19) |
Lovasz Local Lemma: |
|
| Lecture 7 (ArB) (14-08-19) |
Understanding Lovasz Local Lemma and its applications:
Read from (B2), (B6) or (W5)
Constructive Lovasz Local Lemma:
Read from "Miscellaneous Lecture Notes" of (W4) |
|
| Lecture 8 (ArG) (16-08-19) |
Random walk on Z and Z2:
Read Chapter 14 from (W1)
Random Walk on a line graph and 2SAT: |
|
| Lecture 9 (ArG) (19-08-19) |
Chapman-Kolmogrov Equations; |
|
| Lecture 10 (ArG) (23-08-19) |
Periods in MC; |
|
| Lecture 11 (ArG) (26-08-19) |
Proof of Convergence Theorem; |
|
| Lecture 12 (ArB) (26-08-19) |
Random Graph -- G(n,p) and G(n,N) models |
|
| Lecture 13 (ArB) (30-08-19) |
Phase transition: first and second moment method; |
|
| Lecture 14 (ArB) (04-09-19) |
Phase transition (contd.): Emergence of cycles Read mainly from the Chapter on Probabilistic Method in (B2) and also consult the Chapter on second moment in (W8) |
|
| Lecture 15 (ArB) (20-09-19) |
Randomized algorithm for closest pair of points using universal hashing |
- |
| Lecture 16 (ArB) (21-09-19) |
Randomized Incremental Construction and backward analysis: |
- |
| Lecture 17 (ArB) (23-09-19) |
Randomized Incremental Construction and backward analysis: |
- |
| Lecture 18 (ArG) (27-09-19) |
Set systems, primal and dual set systems; |
View Noga Alon's video lecture |
| Lecture 19 (ArG) (30-09-19) |
VC dimension and shallow cell complexity: |
- |
| Lecture 20 (ArG) (03-10-19) |
VC dimension and epsilon-nets |
- |
| Lecture 21 (ArG) (14-10-19) |
VC dimension and epsilon-nets |
- |
| Lecture 22 (ArB) (18-10-19) |
Randomized incremental construction for LP in low dimensions |
- |
| Lecture 23 (ArB) (23-10-19) |
Randomized algorithm for LP (by Clarkson) |
- |
| Lecture 24 (ArB) (25-10-19) |
Randomized lower bounds, Yao's minimax principle |
- |
| Lecture 25 (ArB) (01-11-19) |
Randomized lower bounds for game tree evaluation and sorting: application of Yao's minimax principle
Randomized complexity classes |
- |
| Lecture 26 (ArB) (04-11-19) |
Martingales |
- |
| Lecture 27 (ArB) (08-11-19) |
Martingales: Azuma Hoeffding inequalities |
- |
| Lecture 28 (ArB) (11-11-19) |
Martingales, Lipschitz condition and Azuma Hoeffding inequalities; applications |
- |
| Lecture 29 (ArB) (15-11-19) |
Derandomization using conditional expectation: application using MAX-CUT |
- |