Back close

Course Detail

Course Name Reinforcement Learning
Course Code 24AIM304
Program B.Tech. in Artificial Intelligence (AI) and Data Science (Medical Engineering)
Semester V - Micro-credential courses: Set 4
Credits 3
Campus Coimbatore

Syllabus

Unit 1

Introduction to Reinforcement Learning – History of Reinforcement Learning – Elements of Reinforcement Learning – Limitations and scope.

Unit 2

Multi-armed Bandits – Finite Markov Decision Processes – Dynamic Programming – Policy evaluation – Policy improvement – Policy Iteration – Value Iteration.

Unit 3

Monte Carlo Methods – Monte Carlo prediction – Monte Carlo control – Incremental Implementation – Temporal- Difference Learning – TD prediction – Q-Learning – n-step Bootstrapping.

Unit 4

Planning and Learning with Tabular Methods – Models and planning – Prioritized sweeping – Trajectory sampling – Heuristic search – Rollout algorithms.

Course Objectives and

Course Objectives:

  • To provide a solid introduction to the field of reinforcement learning.
  • To enable the students to learn about the core challenges and approaches, including exploration and exploitation.
  • To expose the students to techniques like Monte Carlo and tabular methods.

Outcomes Course:

After completing this course, students should be able to
CO1: Demonstrate sound understanding of the foundations of Reinforcement Learning
CO2: Demonstrate proficiency in Multi-armed Bandits and Markov Decision Processes
CO3: Apply Monte Carlo Methods and Temporal-Difference Learning
CO4: Apply Tabular Methods in Planning and Learning
CO5: Employ Reinforcement Learning Concepts in Real-world Applications

CO-PO Mapping

CO/PO PO1 PO2 PO3 PO4 PO5 PO6 PO7 PO8 PO9 PO10 PO11 PO12 PSO1 PSO2 PSO3
CO1 3 3 1 2 2 2 2 2 2 2
CO2 3 3 1 2 2 2 2 2 2 2
CO3 3 3 1 2 2 2 2 2 2 2
CO4 3 3 1 2 2 2 2 2 2 2
CO5 3 1 2 2 2 2 2 2 2

Textbooks / References

  1. Richard S. Sutton and Andrew G.Barto, Reinforcement Learning, MIT Press, Second Edition, 2018.

DISCLAIMER: The appearance of external links on this web site does not constitute endorsement by the School of Biotechnology/Amrita Vishwa Vidyapeetham or the information, products or services contained therein. For other than authorized activities, the Amrita Vishwa Vidyapeetham does not exercise any editorial control over the information you may find at these locations. These links are provided consistent with the stated purpose of this web site.

Admissions Apply Now