Multi-agent reinforcement learning control of a hydrostatic wind turbine-based farm

Huang, Yubo; Lin, Shuyue; Zhao, Xiaowei

Abstract

This paper leverages multi-agent reinforcement learning (MARL) to develop an efficient control system for a wind farm comprising a new type of wind turbines with hydrostatic transmission. The primary motivation for hydrostatic wind turbines (HWT) is increased reliability, and reduced manufacturing, operating, and maintaining costs by removing troublesome components and reducing nacelle weight. Nevertheless, the high system complexity of HWT and the wake effect pose significant challenges for the control of HWT-based wind farms. We therefore propose a MARL algorithm named multi-agent policy optimization (MAPO), which allows agents (turbines) to gradually improve their control policies by repeatedly interacting with the environment to learn an optimal operation curve for wind farms. Simulation results based on a wind farm simulator, FAST.Farm, show that MAPO outperforms the greedy policy and a popular learning-based method, multi-agent deep deterministic policy gradient (MADDPG), in terms of power generation.

Citation

Huang, Y., Lin, S., & Zhao, X. (2023). Multi-agent reinforcement learning control of a hydrostatic wind turbine-based farm. IEEE Transactions on Sustainable Energy, https://doi.org/10.1109/tste.2023.3270761

• Journal Article Type: Article
• Acceptance Date: Apr 19, 2023
• Online Publication Date: Apr 26, 2023
• Publication Date: Apr 26, 2023
• Deposit Date: Apr 28, 2023
• Publicly Available Date: May 4, 2023
• Journal: IEEE Transactions on Sustainable Energy
• Print ISSN: 1949-3029
• Electronic ISSN: 1949-3037
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• DOI: https://doi.org/10.1109/tste.2023.3270761
• Keywords: Wind farm control; Hydrostatic wind turbines; Multi-agent reinforcement learning; Power generation
• Public URL: https://hull-repository.worktribe.com/output/4270406