Progress and summary of reinforcement learning on energy management of MPS-EV

Abstract

The escalating environmental concerns and energy crisis caused by internal combustion engines (ICE) have become unacceptable under environmental regulations and the energy crisis. As a promising alternative solution, multi-power source electric vehicles (MPS-EVs) integrate various clean energy systems to enhance the powertrain efficiency. The energy management strategy (EMS) is plays a pivotal role for MPS-EVs to maximize efficiency, fuel economy, and range. Reinforcement Learning (RL) has emerged as an effective methodology for EMS development, attracting continuous attention and research. However, a systematic analysis of the design elements of RL-based EMS is currently lacking. This paper addresses this gap by presenting a comprehensive analysis of current research on RL-based EMS (RL-EMS) and summarizing its design elements. This paper first summarizes the previous applications of RL in EMS from five aspects: algorithm, perception scheme, decision scheme, reward function, and innovative training method. It highlights the contributions of advanced algorithms to training effectiveness, provides a detailed analysis of perception and control schemes, classifies different reward function settings, and elucidates the roles of innovative training methods. Finally, by comparing the development routes of RL and RL-EMS, this paper identifies the gap between advanced RL solutions and existing RL-EMS. Potential development directions are suggested for implementing advanced artificial intelligence (AI) solutions in EMS.

Keywords: Energy management strategy; Multi-power source electric vehicles; Reinforcement learning.