S. Palanivel

Work place: Department of Computer Science and Engineering, Annamalai University, India

E-mail: sapl_yughu@yahoo.com


Research Interests: Computer systems and computational processes, Image Compression, Image Manipulation, Image and Sound Processing, Image Processing, Data Structures and Algorithms


Dr.S. Palanivel is Professor and Head in the Department of Computer Science and Engineering, Faculty of Engineering and Technology, Annamalai University Tamil Nadu India. He earned his Ph.D from Indian Institute of Technology Madras (IITM). He has 86 articles published in international journals, 26 papers published in international conferences, and 40 papers published in national journals and conferences. His research interests include Speech and Image processing, Machine and Deep Learning and other related fields.

Author Articles
Autonomous Taxi Driving Environment Using Reinforcement Learning Algorithms

By Showkat A. Dar S. Palanivel M. Kalaiselvi Geetha

DOI: https://doi.org/10.5815/ijmecs.2022.03.06, Pub. Date: 8 Jun. 2022

Autonomous driving is predicted to alter the transportation industry in the near future. For decades, carmakers, researchers, and administrators have already been working in this sector, with tremendous development. Nevertheless, there are still many uncertainties and obstacles to solve, not only in terms of technical technology, as well as in terms of human consciousness, culture, and present traffic infrastructure. With respect to technological challenges, precise route identification, avoiding the improper location, time delay, erroneous drop-off, unsafe path, and automated navigation in the environment are only a few. RL (Reinforcement Learning) has evolved into a robust learning model which can learn about complications in high dimensional settings, owing to the advent of deep representation learning. Environment learning has been shown to reduce the required time delay, reduce cost of travel, and improve the performance of the agent by discovering a successful drop-off. The major goal is to ensure that an autonomous vehicle driving can reach passengers, pick them up, and transport them to drop-off points as quickly as possible. For performing this task, RL methods like DQNs (Deep Q Networks), Q-LNs (Q-Learning networks) , SARSAs (state action reward state actions), and ConvDQNs (convolution DQNs) are proposed for driving Taxis autonomously. RL agent’s decisions are based on MDPs (Markov Decision Processes). The agent has effectively learnt the closest path, safety, and lower cost, gradually obtaining the capacity to travel bigger areas of the successful drop-off without negative incentive for reaching the target using these RL approaches. This scenario was chosen based on a set of requirements for simulating autonomous vehicles using RL algorithms. Results indicate that ConvDQNs are capable of successfully controlling cars in simulation environments than other RL methods. ConvDQNs are a combinations of CNNs (Convolution Neural Networks) and DQNs. These networks show better results than other methods as their combining of procedures gives improved results. Results indicate that ConvDQNs are capable of successfully controlling a car to navigate around a Taxi-v2 environment than the existing RL methods.

[...] Read more.
Other Articles