International Journal of Engineering and Manufacturing (IJEM)
IJEM Vol. 16, No. 5, 8 Oct. 2026
Cover page and Table of Contents: PDF (size: 1918KB)
A TD3-based Deep Reinforcement Learning algorithm for Voltage Regulation of Dual Active Bridge (DAB) DC-DC Converter under Triple Phase-Shift Modulation
PDF (1918KB), PP.434-457
Views: 0 Downloads: 0
Author(s)
Index Terms
Dual Active Bridge (DAB) converter, Deep Reinforcement Learning (DRL), Adaptive Voltage Regulation, Twin Delayed Deep Deterministic Policy Gradient (TD3), Deep Deterministic Policy Gradient (DDPG), Phase-Shift Modulation Techniques, Model Predictive Contr
Abstract
Owing to the bidirectional power transfer, galvanic isolation and high conversion efficiency, the Dual Active Bridge (DAB) converter has become a popular topology for bidirectional DC-DC power conversion. It applies to electric vehicles, battery energy storage systems and DC microgrids due to its properties. The non-linear input-output characteristics and parameter variations with operating conditions create a difficulty in controlling the output for accurate voltage regulation. A Deep Reinforcement Learning (DRL) control method is proposed to overcome the nonlinearity and voltage regulation issue of the DAB converter. Initially, a state space model and generalized averaging model are used to accurately model the converter dynamics. The control performance is explored in multiple phase-shift modulation techniques like Single Phase Shift (SPS), Extended Phase Shift (EPS), Dual Phase Shift (DPS) and Triple Phase Shift (TPS). A DDPG agent is first implemented for continuous phase-shift control; then, to improve the learning stability, convergence speed and voltage regulation performance, a TD3 agent is introduced. The performance of the proposed DRL is tested and compared to the Grey Wolf Optimizer tuned Proportional–Integral (GWO-PI) control and Model Predictive Control (MPC) for various input voltage and loading conditions. The simulation results show that the settling time of the proposed TD3 controller is 4.3ms, which is 35% lower than that of the MPC and GWO-PI controllers. The steady state voltage ripple of the proposed TD3 controller is reduced by 35% compared to the MPC and GWO-PI controllers. The voltage regulation accuracy of the proposed TD3 controller is better than that of the MPC and GWO-PI controllers.
Cite This Paper
K.Girinath Babu, J.Sivavara Prasad, V.Vasudevan, "A TD3-based Deep Reinforcement Learning algorithm for Voltage Regulation of Dual Active Bridge (DAB) DC-DC Converter under Triple Phase-Shift Modulation", International Journal of Engineering and Manufacturing (IJEM), Vol.16, No.5, pp. 434-457, 2026. DOI:10.5815/ijem.2026.05.23
Reference
[1]Dinesh Vuppalapati and E. Shiva Prasad, “Simulation of Dual Active Converter for Energy Storage System.” International Journal of Engineering Trends and Technology (IJETT), Vol. 27 No. 2, pp. 79-83, Sept 2015. DOI: https://doi.org/10.14445/22315381/IJETT-V27P213
[2]G. Barone et al., "A dual active bridge dc-dc converter for application in a smart user network," 2014 Australasian Universities Power Engineering Conference (AUPEC), Perth, Australia, 2014, pp. 1-5. DOI: https://doi.org/10.1109/AUPEC.2014.6966538
[3]S. H. Hosseini, M. Sabahi, F. Sedaghati and G. B. Gharehpetian, "A new extended topology for dual active bridge DC-DC converter," 2015 IEEE Electrical Power and Energy Conference (EPEC), London, ON, Canada, 2015, pp. 391-396.
[4]Y. Kado, S. Okutani, K. Katagiri and P. -Y. Huang, "Autonomous DC Microgrid Consisting of Triple Active Bridge Converters," 2019 IEEE Third International Conference on DC Microgrids (ICDCM), Matsue, Japan, 2019, pp. 1-5. DOI: https://doi.org/10.1109/ICDCM45535.2019.9232828
[5]J. Saha, N. B. Yadav Gorla and S. K. Panda, "Modulation of Direct Matrix-Based Dual-Active-Bridge (MB-DAB) AC-DC Converters," 2021 IEEE 12th Energy Conversion Congress & Exposition - Asia (ECCE-Asia), Singapore, Singapore, 2021, pp. 74-79. DOI: https://doi.org/10.1109/ECCE-Asia49820.2021.9479303
[6]Y. Sang, A. Junyent-Ferré and T. C. Green, "Operational Principles of Three-Phase Single Active Bridge DC/DC Converters Under Duty Cycle Control," in IEEE Transactions on Power Electronics, vol. 35, no. 8, pp. 8737-8750, Aug. 2020. DOI: https://doi.org/10.1109/TPEL.2019.2961400
[7]F. Deng and Z. Chen, "Control of Improved Full-Bridge Three-Level DC/DC Converter for Wind Turbines in a DC Grid," in IEEE Transactions on Power Electronics, vol. 28, no. 1, pp. 314-324, Jan. 2013. DOI: https://doi.org/10.1109/TPEL.2012.2201437
[8]R. Suryadevara and L. Parsa, "Full-Bridge ZCS-Converter-Based High-Gain Modular DC-DC Converter for PV Integration with Medium-Voltage DC Grids," in IEEE Transactions on Energy Conversion, vol. 34, no. 1, pp. 302-312, March 2019. DOI: https://doi.org/10.1109/TEC.2018.2877278
[9]W. Phetphimoon and K. Bhumkittipich, "Modelling and simulation of bidirectional half bridge DC-DC converter," 2016 13th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications, and Information Technology (ECTI-CON), Chiang Mai, Thailand, 2016, pp. 1-6. DOI: https://doi.org/10.1109/ECTICon.2016.7561475
[10]V. F. Pires, D. Foito, A. Cordeiro and A. J. Pires, "A Bidirectional DC-DC Converter to Interlink Unipolar and Bipolar DC Microgrids," 2021 9th International Conference on Smart Grid (icSmartGrid), Setubal, Portugal, 2021, pp. 37-42. DOI: https://doi.org/10.1109/icSmartGrid52357.2021.9551209
[11]L. Litvani and J. Hamar, "New Five Level Resonant DC/DC Buck-Boost Converter," 2018 International Conference on Smart Energy Systems and Technologies (SEST), Seville, Spain, 2018, pp. 1-6. DOI: https://doi.org/10.1109/SEST.2018.8495765
[12]J. Zeng, X. Du and Z. Yang, "A Multiport Bidirectional DC–DC Converter for Hybrid Renewable Energy System Integration," in IEEE Transactions on Power Electronics, vol. 36, no. 11, pp. 12281-12291, Nov. 2021. DOI: https://doi.org/10.1109/TPEL.2021.3089382
[13]M. S. Bhaskar, R. Alammari, M. Meraj, S. Padmanaban and A. Iqbal, "A New Triple-Switch-Triple-Mode High Step-Up Converter With Wide Range of Duty Cycle for DC Microgrid Applications," in IEEE Transactions on Industry Applications, vol. 55, no. 6, pp. 7425-7441, Nov.-Dec. 2019. DOI: https://doi.org/10.1109/TIA.2019.2935238
[14]A. S. Mansour, A. H. H. Amer, E. E. El-Kholy, & M. S. Zaky, “High gain DC/DC converter with continuous input current for renewable energy applications,” Scientific Reports, vol. 12, iss. 1, 2022, pp. 12138. DOI: https://doi.org/10.1038/s41598-022-16144-0
[15]P.R. Kumar, C.G. Shankar, “High-performance single-input three-output DC–DC high gain converter for fuel cell-based electric vehicles,” Electrical Engineering, Springer, vol. 102, 2020, pp. 1715–1737. DOI: https://doi.org/10.1007/s00202-020-00986-z
[16]A. Shoaei, K. Abbaszadeh and H. Allahyari, "A Single-Inductor Multi-Input Multilevel High Step-Up DC–DC Converter Based on Switched-Diode-Capacitor Cells for PV Applications," in IEEE Journal of Emerging and Selected Topics in Industrial Electronics, vol. 4, no. 1, pp. 18-27, Jan. 2023. DOI: https://doi.org/10.1109/JESTIE.2022.3209838
[17]M. Diwakar Naik and U. Vinatha, "A Novel Dual-Input Single-Output High-Gain DC–DC Converter for Interfacing Fuel Cell With High-Way Charging Station Applications," in IEEE Transactions on Transportation Electrification, vol. 11, no. 1, pp. 4271-4279, Feb. 2025. DOI: https://doi.org/10.1109/TTE.2024.3490845
[18]C. Buccella, C. Cecati and P. Siano, "A fuzzy-logic-controlled resonant converter for renewable energy sources applications," IECON 2011 - 37th Annual Conference of the IEEE Industrial Electronics Society, Melbourne, VIC, Australia, 2011, pp. 2450-2455. DOI: https://doi.org/10.1109/IECON.2011.6119694
[19]K. Yu, F. Zhuo, F. Wang and X. Jiang, "Deep-Learning-Based Steady-State Modeling and Model Predictive Control for CLLC DC-DC Resonant Converter in DC Distribution System," 2022 IEEE Applied Power Electronics Conference and Exposition (APEC), Houston, TX, USA, 2022, pp. 1-5. DOI: https://doi.org/10.1109/APEC43599.2022.9773460
[20]T. Anitha and N. Nachammai, "Simulation of Single-Input Fuzzy Logic Control of Multi-output Zero-Voltage Switching Push-pull Quasi-resonant Converter," 2019 11th International Conference on Advanced Computing (ICoAC), Chennai, India, 2019, pp. 173-179.
[21]N. Hou, W. Song and M. Wu, "Minimum-Current-Stress Scheme of Dual Active Bridge DC–DC Converter With Unified Phase-Shift Control," in IEEE Transactions on Power Electronics, vol. 31, no. 12, pp. 8552-8561, Dec. 2016. DOI: https://doi.org/10.1109/TPEL.2016.2521410
[22]S. A. Gorji, H. G. Sahebi, M. Ektesabi and A. B. Rad, "Topologies and Control Schemes of Bidirectional DC–DC Power Converters: An Overview," in IEEE Access, vol. 7, pp. 117997-118019, 2019. DOI: https://doi.org/10.1109/ACCESS.2019.2932519
[23]A. Rajamallaiah, S. P. K. Karri, M. L. Alghaythi and M. S. Alshammari, "Deep Reinforcement Learning Based Control of a Grid Connected Inverter With LCL-Filter for Renewable Solar Applications," in IEEE Access, vol. 12, pp. 22278-22295, 2024. DOI: https://doi.org/10.1109/ACCESS.2024.3365554
[24]A. Rajamallaiah, S. P. K. Karri and Y. R. Shankar, "Deep Reinforcement Learning Based Control Strategy for Voltage Regulation of DC-DC Buck Converter Feeding CPLs in DC Microgrid," in IEEE Access, vol. 12, pp. 17419-17430, 2024. DOI: https://doi.org/10.1109/ACCESS.2024.3358926
[25]J. Ye, H. Guo, D. Zhao, B. Wang and X. Zhang, "TD3 Algorithm Based Reinforcement Learning Control for Multiple-Input Multiple-Output DC–DC Converters," in IEEE Transactions on Power Electronics, vol. 39, no. 10, pp. 12729-12742, Oct. 2024. DOI: https://doi.org/10.1109/TPEL.2024.3402482
[26]Y. Harrye, A. Ahmed, and H. Mahasneh. “The Generalization of Bidirectional Dual Active Bridge DC/DC Converter Modulation Schemes: State-of-the-Art Analysis under Triple Phase Shift Control,” Energies, vol. 16, no. 22, pp. 7577, 2023. DOI: https://doi.org/10.3390/en16227577
[27]F. An, W. Song, K. Yang, N Hou and J. Ma, “Improved dynamic performance of dual active bridge dc-dc converters using MPC scheme” IET Power Electronics, 11, pp. 1756 – 1765, 2018. DOI: https://doi.org/10.1049/iet-pel.2017.0865
[28]S. Zou, S. Zheng and M. Chinthavali, "Design, Analyses and Validation of Sliding Mode Control for a DAB DC-DC Converter," 2019 IEEE Transportation Electrification Conference and Expo (ITEC), Detroit, MI, USA, 2019, pp. 1-6. DOI: https://doi.org/10.1109/ITEC.2019.8790590
[29]S. M. Akbar, A. Hasan, A. J. Watson and P. Wheeler, "Model Predictive Control with Triple Phase Shift Modulation for a Dual Active Bridge DC-DC Converter," in IEEE Access, vol. 9, pp. 98603-98614, 2021. DOI: http://doi.org/10.1109/ACCESS.2021.3097263
[30]N. Tiwary, V. N. Naik, A. K. Panda, A. Narendra and R. K. Lenka, "Fuzzy Logic Based Direct Power Control of Dual Active Bridge Converter," 2021 1st International Conference on Power Electronics and Energy (ICPEE), Bhubaneswar, India, 2021, pp. 1-5. DOI: https://doi.org/10.1109/ICPEE50452.2021.9358536
[31]A. A. Amin, A. Mubarak and S. Waseem, “Application of physics-informed neural networks in fault diagnosis and fault-tolerant control design for electric vehicles: A review,” Measurement, vol. 246, 2025, 116728. DOI: https://doi.org/10.1016/j.measurement.2025.116728