Eco-Driving With Partial Wireless Charging Lane at Signalized Intersection: A Reinforcement Learning Approach

Ren, Xinxing; Lai, Chun Sing; Guo, Zekun; Taylor, Gareth

Abstract

Consumer electronics such as advanced GPS, vehicular sensors, inertial measurement units (IMUs), and wireless modules integrate vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) within internet of thing (IoT), enabling connected autonomous electric vehicles (CAEVs) to optimize energy optimization through eco-driving. In scenarios with traffic light intersections and partial wireless charging lanes (WCL), an eco-driving algorithm must consider net and gross energy consumption, safety, and traffic efficiency. We introduced a deep reinforcement learning (DRL) based eco-driving control approach, employing a twin-delayed deep deterministic policy gradient (TD3) agent for real-time acceleration planning. This approach uses reward functions for acceleration, velocity, safety, and efficiency, incorporating a dynamic velocity range model which not only enables the vehicle to smoothly pass the signalized intersections but also uses partial WCL efficiently and time-adaptively while ensuring traffic efficiency in diverse traffic scenarios. Tested in Simulation of Urban Mobility (SUMO) across various intersections with partial WCL, our method significantly lowered net and gross energy consumption by up to 44.01% and 17.19%, respectively, compared to conventional driving, while adhering to traffic and safety norms.

Citation

Ren, X., Lai, C. S., Guo, Z., & Taylor, G. (2024). Eco-Driving With Partial Wireless Charging Lane at Signalized Intersection: A Reinforcement Learning Approach. IEEE Transactions on Consumer Electronics, https://doi.org/10.1109/tce.2024.3482101

• Journal Article Type: Article
• Acceptance Date: Oct 11, 2024
• Online Publication Date: Oct 16, 2024
• Publication Date: 2024
• Deposit Date: Oct 24, 2024
• Publicly Available Date: Oct 24, 2024
• Journal: IEEE Transactions on Consumer Electronics
• Print ISSN: 0098-3063
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• DOI: https://doi.org/10.1109/tce.2024.3482101
• Keywords: Consumer electronics; Vehicle-to-vehicle communications; Vehicle-to-infrastructure communication; Connected autonomous electric vehicles; Autonomous electric vehicles; Eco-driving; Wireless charging lane; Deep reinforcement learning
• Public URL: https://hull-repository.worktribe.com/output/4870769