earticle

영어

This study presents model-free reinforcement learn ing methods for economic and ecological adaptive cruise control (Eco-ACC) of connected and autonomous electric vehicles. For model-free optimal control of Eco-ACC, we applied two reinforcement learning methods, Deep Q-Network (DQN) and Deep Deterministic Policy Gradient (DDPG), in which deep neural networks of actors and critics were trained using IPG CarMaker simulations. For performance demonstrations, the HWFET, US06, and WLTP Class 3b driving cycles were used to simulate the front vehicle, and the energy consumptions of the host vehicle and front vehicle were compared. In high-fidelity IPG CarMaker simulations, the proposed reinforcement learning- based Eco-ACC methods demonstrated approximately 3–5% and 10–14% efficiency improvements in highway and city-highway driving scenarios, respectively, when compared with the front vehicle. A video of the CarMaker simulation is available at https://youtu.be/DIXzJxMVig8.