A Reinforcement Learning-based Assignment Scheme for EVs to Charging Stations

Aljaidi, Mohammad; Aslam, Nauman; Chen, Xiaomin; Kaiwartya, Omprakash; Al-Gumaei, Ali; Khalid, Muhammad

Abstract

Due to recent developments in electric mobility, public charging infrastructure will be essential for modern transportation systems. As the number of electric vehicles (EVs) increases, the public charging infrastructure needs to adopt efficient charging practices. A key challenge is the assignment of EVs to charging stations (CSs) in an energy efficient manner. In this paper, a Reinforcement Learning (RL)-based EV Assignment Scheme (RL-EVAS) is proposed to solve the problem of assigning EV to the optimal CS in urban environments, aiming at minimizing the total cost of charging EVs and reducing the overload on Electrical Grids (EGs). Travelling cost that is resulted from the movement of EV to CS, and the charging cost at CS are considered. Moreover, the EV's Battery State of Charge (SoC) is taken into account in the proposed scheme. The proposed RL-EVAS approach will approximate the solution by finding an optimal policy function in the sense of maximizing the expected value of the total reward over all successive steps using Q-learning algorithm, based on the Temporal Difference (TD) learning and Bellman expectation equation. Finally, the numerous simulation results illustrate that the proposed scheme can significantly reduce the total energy cost of EVs compared to various case studies and greedy algorithm, and also demonstrate its behavioural adaptation to any environmental conditions.

Citation

Aljaidi, M., Aslam, N., Chen, X., Kaiwartya, O., Al-Gumaei, A., & Khalid, M. (2022, June). A Reinforcement Learning-based Assignment Scheme for EVs to Charging Stations. Presented at 2022 IEEE 95th Vehicular Technology Conference: VTC2022-Spring, Helsinki, Finland

• Presentation Conference Type: Conference Paper (published)
• Conference Name: 2022 IEEE 95th Vehicular Technology Conference: VTC2022-Spring
• Start Date: Jun 19, 2022
• End Date: Jun 22, 2022
• Acceptance Date: Mar 9, 2022
• Online Publication Date: Aug 25, 2022
• Publication Date: 2022
• Deposit Date: Jan 31, 2023
• Publicly Available Date: Apr 6, 2023
• Publisher: Institute of Electrical and Electronics Engineers
• Book Title: IEEE 95th Vehicular Technology Conference: VTC2022-Spring
• DOI: https://doi.org/10.1109/VTC2022-Spring54318.2022.9860535
• Keywords: Index Terms-Electric vehicle assignment; charging sta- tion; Q-learning; temporal difference; Bellman expectation equation; energy consumption; energy cost; electrical grids
• Public URL: https://hull-repository.worktribe.com/output/3983641