Jingjie Xie
Wind Turbine Fault-Tolerant Control via Incremental Model-Based Reinforcement Learning
Xie, Jingjie; Dong, Hongyang; Zhao, Xiaowei; Lin, Shuyue
Authors
Hongyang Dong
Xiaowei Zhao
Dr Shuyue Lin S.Lin@hull.ac.uk
Lecturer in Electrical and Electronic Engineering
Abstract
A reinforcement learning (RL) based fault-tolerant control strategy is developed in this paper for wind turbine torque & pitch control under actuator & sensor faults subject to unknown system models. An incremental model-based heuristic dynamic programming (IHDP) approach, along with a critic-actor structure, is designed to enable fault-tolerance capability and achieve optimal control. Particularly, an incremental model is embedded in the critic-actor structure to quickly learn the potential system changes, such as faults, in real-time. Different from the current IHDP methods that need the intensive evaluation of the state and input matrices, only the input matrix of the incremental model is dynamically evaluated and updated by an online recursive least square estimation procedure in our proposed method. Such a design significantly enhances the online model evaluation efficiency and control performance, especially under faulty conditions. In addition, a value function and a target critic network are incorporated into the main critic-actor structure to improve our method’s learning effectiveness. Case studies for wind turbines under various working conditions are conducted based on the fatigue, aerodynamics, structures, and turbulence (FAST) simulator to demonstrate the proposed method’s solid fault-tolerance capability and adaptability. Note to Practitioners —This work achieves high-performance wind turbine control under unknown actuator & sensor faults. Such a task is still an open problem due to the complexity of turbine dynamics and potential uncertainties in practical situations. A novel data-driven and model-free control strategy based on reinforcement learning is proposed to handle these issues. The designed method can quickly capture the potential changes in the system and adjust its control policy in real-time, rendering strong adaptability and fault-tolerant abilities. It provides data-driven innovations for complex operational tasks of wind turbines and demonstrates the feasibility of applying reinforcement learning to handle fault-tolerant control problems. The proposed method has a generic structure and has the potential to be implemented in other renewable energy systems.
Citation
Xie, J., Dong, H., Zhao, X., & Lin, S. (in press). Wind Turbine Fault-Tolerant Control via Incremental Model-Based Reinforcement Learning. IEEE transactions on Automation Science and Engineering, https://doi.org/10.1109/TASE.2024.3372713
Journal Article Type | Article |
---|---|
Acceptance Date | Feb 28, 2024 |
Online Publication Date | Mar 5, 2024 |
Deposit Date | Feb 29, 2024 |
Publicly Available Date | Mar 8, 2024 |
Journal | IEEE transactions on Automation Science and Engineering |
Print ISSN | 1545-5955 |
Publisher | Institute of Electrical and Electronics Engineers |
Peer Reviewed | Peer Reviewed |
DOI | https://doi.org/10.1109/TASE.2024.3372713 |
Keywords | Fault-tolerant control; Reinforcement learning; Wind turbine control; Intelligent control |
Public URL | https://hull-repository.worktribe.com/output/4566577 |
Files
Accepted manuscript
(8.8 Mb)
PDF
Copyright Statement
© 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
You might also like
Downloadable Citations
About Repository@Hull
Administrator e-mail: repository@hull.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search