Schedule

Lecture Notes:

• Chapter 0

Lecture Notes:

• Chapter 1 - Section 1

Further Reads:

• Intro to RL: Chapter 1 - Sections 1.1 and 1.2 of [SB]

Lecture Notes:

• Chapter 1 - Section 1

Further Reads:

• k-armed Bandit: Chapter 2 - Section 2.1 of [SB]
• Robbins’ Paper: Paper Some aspects of the sequential design of experiments by H. Robbins published in the Bulletin of the American Mathematical Society in 1952 formulating multi-armed bandit as we know it nowadays

Lecture Notes:

• Chapter 1 - Section 1

Further Reads:

• k-armed Bandit: Chapter 2 - Section 2.1 of [SB]
• Robbins’ Paper: Paper Some aspects of the sequential design of experiments by H. Robbins published in the Bulletin of the American Mathematical Society in 1952 formulating multi-armed bandit as we know it nowadays

Lecture Notes:

• Chapter 1 - Section 2

Further Reads:

• RL Setting: Chapter 3 - Sections 3.1 to 3.3 of [SB]

Lecture Notes:

• Chapter 1 - Section 2

Further Reads:

• RL Setting: Chapter 3 - Sections 3.1 to 3.3 of [SB]

Lecture Notes:

• Chapter 1 - Section 2

Lecture Notes:

• Chapter 1 - Section 3

Further Reads:

• RL Setting: Chapter 1 - Sections 1.3 and 1.4 of [SB]

Lecture Notes:

• Chapter 1 - Section 3

Further Reads:

• RL Setting: Chapter 1 - Section 1.5 of [SB]

Lecture Notes:

• Chapter 1 - Section 3

Lecture Notes:

• Chapter 1 - Section 4

Further Reads:

• RL Setting: Chapter 3 - Section 3.4 of [SB]

Lecture Notes:

• Chapter 2 - Section 1

Further Reads:

• RL Setting: Chapter 3 - Sections 3.1 and 3.3 of [SB]

Lecture Notes:

• Chapter 2 - Section 1

Further Reads:

• RL Setting: Chapter 3 - Section 3.5 [SB]

Lecture Notes:

• Chapter 2 - Section 1

Further Reads:

• Bellman: Chapter 3 - Section 3.6 [SB]

Lecture Notes:

• Chapter 2 - Section 1

Further Reads:

• Bellman: Chapter 3 - Section 3.6 [SB]

Lecture Notes:

• Chapter 2 - Section 2

Further Reads:

• Optimal Policy: Chapter 3 - Section 3.7 [SB]

Lecture Notes:

• Chapter 2 - Section 2

Further Reads:

• Optimal Policy: Chapter 3 - Section 3.7 [SB]

Lecture Notes:

• Chapter 2 - Section 3

Further Reads:

• Policy Evaluation: Chapter 4 - Section 4.1 of [SB]

Lecture Notes:

• Chapter 2 - Section 3

Further Reads:

• Policy Improvement and Iteration: Chapter 4 - Sections 4.2 and 4.3 of [SB]

Lecture Notes:

• Chapter 2 - Section 3

Further Reads:

• Value Iteration: Chapter 4 - Section 4.4 of [SB]

Lecture Notes:

• Chapter 2 - Section 3

Further Reads:

• Generalized Policy Iteration: Chapter 4 - Sections 4.6 and 4.7 of [SB]

Lecture Notes:

• Chapter 3 - Section 1

Further Reads:

• Monte-Carlo: Chapter 5 - Sections 5.1 and 5.2 of [SB]

Lecture Notes:

• Chapter 3 - Section 1

Further Reads:

• Monte-Carlo: Chapter 5 - Section 5.3 of [SB]

Lecture Notes:

• Chapter 3 - Section 2

Further Reads:

• TD-0: Chapter 6 - Section 6.1 of [SB]

• Chapter 3 - Section 2

Further Reads:

• TD-0: Chapter 6 - Sections 6.2 and 6.3 of [SB]

• Chapter 3 - Section 3

Further Reads:

• TD-n: Chapter 7 - Sections 7.1 and 7.2 of [SB]

• Chapter 3 - Section 3

Further Reads:

• TD-lambda: Chapter 12 - Sections 12.1 to 12.3 of [SB]

• Chapter 3 - Section 3

Further Reads:

• Eligibility Tracing: Chapter 12 - Sections 12.4 and 12.5 of [SB]

• Chapter 3 - Section 4

Further Reads:

• MC Control: Chapter 5 - Sections 5.3 and 5.4 of [SB]

• Chapter 3 - Section 4

Further Reads:

• ε-Greedy: Chapter 2 - Sections 2.5 and 2.6 of [SB]