Skip to main content

Research Repository

Advanced Search

Wind Turbine Fault-Tolerant Control via Incremental Model-Based Reinforcement Learning

Xie, Jingjie; Dong, Hongyang; Zhao, Xiaowei; Lin, Shuyue

Authors

Jingjie Xie

Hongyang Dong

Xiaowei Zhao

Profile image of Shuyue Lin

Dr Shuyue Lin S.Lin@hull.ac.uk
Lecturer in Electrical and Electronic Engineering



Abstract

A reinforcement learning (RL) based fault-tolerant control strategy is developed in this paper for wind turbine torque & pitch control under actuator & sensor faults subject to unknown system models. An incremental model-based heuristic dynamic programming (IHDP) approach, along with a critic-actor structure, is designed to enable fault-tolerance capability and achieve optimal control. Particularly, an incremental model is embedded in the critic-actor structure to quickly learn the potential system changes, such as faults, in real-time. Different from the current IHDP methods that need the intensive evaluation of the state and input matrices, only the input matrix of the incremental model is dynamically evaluated and updated by an online recursive least square estimation procedure in our proposed method. Such a design significantly enhances the online model evaluation efficiency and control performance, especially under faulty conditions. In addition, a value function and a target critic network are incorporated into the main critic-actor structure to improve our method’s learning effectiveness. Case studies for wind turbines under various working conditions are conducted based on the fatigue, aerodynamics, structures, and turbulence (FAST) simulator to demonstrate the proposed method’s solid fault-tolerance capability and adaptability. Note to Practitioners —This work achieves high-performance wind turbine control under unknown actuator & sensor faults. Such a task is still an open problem due to the complexity of turbine dynamics and potential uncertainties in practical situations. A novel data-driven and model-free control strategy based on reinforcement learning is proposed to handle these issues. The designed method can quickly capture the potential changes in the system and adjust its control policy in real-time, rendering strong adaptability and fault-tolerant abilities. It provides data-driven innovations for complex operational tasks of wind turbines and demonstrates the feasibility of applying reinforcement learning to handle fault-tolerant control problems. The proposed method has a generic structure and has the potential to be implemented in other renewable energy systems.

Citation

Xie, J., Dong, H., Zhao, X., & Lin, S. (in press). Wind Turbine Fault-Tolerant Control via Incremental Model-Based Reinforcement Learning. IEEE transactions on Automation Science and Engineering, https://doi.org/10.1109/TASE.2024.3372713

Journal Article Type Article
Acceptance Date Feb 28, 2024
Online Publication Date Mar 5, 2024
Deposit Date Feb 29, 2024
Publicly Available Date Mar 8, 2024
Journal IEEE transactions on Automation Science and Engineering
Print ISSN 1545-5955
Publisher Institute of Electrical and Electronics Engineers
Peer Reviewed Peer Reviewed
DOI https://doi.org/10.1109/TASE.2024.3372713
Keywords Fault-tolerant control; Reinforcement learning; Wind turbine control; Intelligent control
Public URL https://hull-repository.worktribe.com/output/4566577

Files

Accepted manuscript (8.8 Mb)
PDF

Copyright Statement
© 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.




You might also like



Downloadable Citations