M. J. Nigam

Work place: System Modeling and Control Group, Department of Electronics and Computer Engineering, Indian Institute of Technology Roorkee, INDIA

E-mail: mkndnfec@iitr.ernet.in


Research Interests: Computer systems and computational processes, Computer Vision, Real-Time Computing


M J NIGAM joined the faculty of University of Roorkee (Now IIT - Roorkee), Roorkee, India in the Department of Electronics and Computer Engineering. His main research interests  for the thrust areas of Electronics and Computer Engineering are  Guidance & Controls in Navigational Systems including high resolution real time intelligent Kalman State Estimator as well as Regulation, Tracking and Guidance for peace time work and industry also. High-resolution intelligent vision systems, smart/brilliant/Intelligent weapons like ICBM, & real time adaptive filtering, smoothing and prediction are some of his allied topics of interest in the field of Guidance and Control.

Author Articles
Temporal Difference based Tuning of Fuzzy Logic Controller through Reinforcement Learning to Control an Inverted Pendulum

By Raj Kumar M. J. Nigam Sudeep Sharma Punitkumar Bhavsar

DOI: https://doi.org/10.5815/ijisa.2012.09.02, Pub. Date: 8 Aug. 2012

This paper presents a self-tuning method of fuzzy logic controllers. The consequence part of the fuzzy logic controller is self-tuned through the Q-learning algorithm of reinforcement learning. The off policy temporal difference algorithm is used for tuning which directly approximate the action value function which gives the maximum reward. In this way, the Q-learning algorithm is used for the continuous time environment. The approach considered is having the advantage of fuzzy logic controller in a way that it is robust under the environmental uncertainties and no expert knowledge is required to design the rule base of the fuzzy logic controller.

[...] Read more.
Other Articles