Back close

Humanoid Robot Gait Control Using PPO, SAC, and ES Algorithms

Publication Type : Conference Paper

Publisher : IEEE

Source : 2023 4th IEEE Global Conference for Advancement in Technology (GCAT)

Url : https://doi.org/10.1109/gcat59970.2023.10353490

Campus : Bengaluru

School : School of Computing

Year : 2023

Abstract : Gait control is the primary aspect in the case of humanoid robots as it directly has an influence on the stability and locomotion of the robot. This paper provides a comparative analysis of the three reinforcement learning algorithms namely Proximal Policy Optimization (PPO), Soft-Actor Critic (SAC), and Evolutionary Strategies (ES) for the gait control in the humanoid robot. The main aim of the project is to study the effect of the behavior of the considered algorithms and make an inference on the behavior of the robot on fine-tuning the hyperparameters. The Brax environment, a simulation platform which is developed by Google and written in JAX is considered to evaluate the performance of the considered humanoid robot. Out of the considered algorithms, PPO gave the best reward of 11580. © 2023 IEEE.

Cite this Research Publication : Savarala Chethana, Sreevathsa Sree Charan, Vemula Srihitha, J Amudha, Humanoid Robot Gait Control Using PPO, SAC, and ES Algorithms, 2023 4th IEEE Global Conference for Advancement in Technology (GCAT), IEEE, 2023, https://doi.org/10.1109/gcat59970.2023.10353490

Admissions Apply Now