DDPG优化算法的改进型自抗扰风电机组桨距角控制

徐晓宁; 范召强; 周雪松; 陶珑; 问虎龙; 杨风霞

doi:10.19912/j.0254-0096.tynxb.2024-1586

PDF(1499 KB)

太阳能学报 ›› 2026, Vol. 47 ›› Issue (1) : 575-584. DOI: 10.19912/j.0254-0096.tynxb.2024-1586

DDPG优化算法的改进型自抗扰风电机组桨距角控制

徐晓宁¹, 范召强¹, 周雪松¹, 陶珑¹, 问虎龙^2,3, 杨风霞⁴

作者信息 +

IMPROVED ACTIVE DISTURBANCE REJECTION FOR WIND TURBINE PITCH ANGLE CONTROL BASED ON DDPG OPTIMIZATION ALGORITHM

Xu Xiaoning¹, Fan Zhaoqiang¹, Zhou Xuesong¹, Tao Long¹, Wen Hulong^2,3, Yang Fengxia⁴

Author information +

文章历史 +

摘要

为解决传统风电机组桨距角控制策略面对风速变化时存在动态响应差以及控制器参数适应性不足导致输出功率波动大的问题,提出一种基于深度确定性策略梯度（DDPG）算法的改进型线性自抗扰桨距角控制策略。该策略在线性扩张状态观测器（LESO）基础上引入自由扩张维度的状态变量,并对增阶后的参数基于比例微分形式进行改进,以提高对扰动的顺馈矫正能力。随后根据发电机转速误差设计合适的奖励函数,利用DDPG算法使改进后的线性自抗扰控制（LADRC）参数能够自适应调整,实现最优的控制效果。仿真结果表明,所提策略能有效应对风速剧烈波动,使桨距角能快速适应风速变化,从而维持风电机组的稳定运行和电能的高效输出。

Abstract

To address the issues of poor dynamic response and insufficient adaptability of controller parameters leading to significant output power fluctuations when traditional wind turbine pitch angle control strategies are confronted with wind speed variations, an improved linear active disturbance rejection pitch angle control strategy based on Deep Deterministic Policy Gradient （DDPG） algorithm is proposed. The proposed strategy introduces an additional free expansion dimension state variable on top of the linear extended state observer （LESO） and improved the parameters of the expanded system in a proportional-derivative form to enhance the capability of disturbance feedforward compensation. Then, an appropriate reward function is designed according to the generator speed error, and the improved linear active disturbance rejection control （LADRC） parameters can be adjusted adaptively by using DDPG algorithm, so as to achieve the optimal control effect. The simulation results show that the proposed strategy can make the pitch angle quickly adapt to the changes in wind speed and effectively deal with the violent fluctuation of wind speed, therefore maintaining the stable operation of wind turbine and the efficient output of electric energy.

导出引用

徐晓宁, 范召强, 周雪松, 陶珑, 问虎龙, 杨风霞. DDPG优化算法的改进型自抗扰风电机组桨距角控制[J]. 太阳能学报. 2026, 47(1): 575-584 https://doi.org/10.19912/j.0254-0096.tynxb.2024-1586

Xu Xiaoning, Fan Zhaoqiang, Zhou Xuesong, Tao Long, Wen Hulong, Yang Fengxia. IMPROVED ACTIVE DISTURBANCE REJECTION FOR WIND TURBINE PITCH ANGLE CONTROL BASED ON DDPG OPTIMIZATION ALGORITHM[J]. Acta Energiae Solaris Sinica. 2026, 47(1): 575-584 https://doi.org/10.19912/j.0254-0096.tynxb.2024-1586

中图分类号： TM614

参考文献

[1] 曹晨光. 风电场并网对电网电能质量的影响分析[J]. 电气时代, 2023(5): 60-62.
CAO C G.Analysis of the impact of wind farm grid connection on power quality[J]. Electric age, 2023(5): 60-62.
[2] 王爽心, 李朝霞. 变桨距风电机组自适应PI优化控制[J]. 太阳能学报, 2013, 34(9): 1579-1586.
WANG S X, LI Z X.Adaptive PI optimization control for variable-pitch wind turbines[J]. Acta energiae solaris sinica, 2013, 34(9): 1579-1586.
[3] 周峰, 田德, 邓英, 等. 不对称载荷的独立变桨控制[J]. 太阳能学报, 2016, 37(12): 3150-3154.
ZHOU F, TIAN D, DENG Y, et al.Individual pitch control based on asymmetric loads[J]. Acta energiae solaris sinica, 2016, 37(12): 3150-3154.
[4] 刘颖明, 朱江生, 姚兴佳, 等. 基于H₂/H_∞混合优化的大型风电机组变桨距鲁棒控制技术研究[J]. 太阳能学报, 2015, 36(3): 714-719.
LIU Y M, ZHU J S, YAO X J, et al.Lmi-based H₂/H_∞ robust pitch control technology for wind turbine[J]. Acta energiae solaris sinica, 2015, 36(3): 714-719.
[5] 田德, 黄明月, 唐世泽, 等. 大型风电机组输出功率与塔架载荷自抗扰控制[J]. 太阳能学报, 2023, 44(5): 466-472.
TIAN D, HUANG M Y, TANG S Z, et al.Output power and tower load control of large-scale wind turbines based on active disturbance rejection control[J]. Acta energiae solaris sinica, 2023, 44(5): 466-472.
[6] 夏长亮, 宋战锋. 变速恒频风力发电系统变桨距自抗扰控制[J]. 中国电机工程学报, 2007, 27(14): 91-95.
XIA C L, SONG Z F.Pitch control of variable speed constant frequency wind turbines based on active-disturbance-rejection controller[J]. Proceedings of the CSEE, 2007, 27(14): 91-95.
[7] GAO Z Q.Scaling and bandwidth-parameterization based controller tuning[C]//Proceedings of the 2003 American Control Conference. Denver, CO, USA, 2003: 4989-4996.
[8] 贾建芳, 张吉宣, 戴媛媛, 等. 基于CPSO算法的风力机变桨距自抗扰控制[J]. 机械设计与制造, 2020(2): 51-55.
JIA J F, ZHANG J X, DAI Y Y, et al.Variable pitch control of wind turbines using active disturbance rejection control based on CPSO algorithm[J]. Machinery design & manufacture, 2020(2): 51-55.
[9] JAFARNEJADSANI H, PIEPER J, EHLERS J.Adaptive control of a variable-speed variable-pitch wind turbine using radial-basis function neural network[J]. IEEE transactions on control systems technology, 2013, 21(6): 2264-2272.
[10] 宋文静, 谢源, 黄文君, 等. 一种基于改进自抗扰控制器的风电机组变桨距控制策略[J]. 科学技术与工程, 2020, 20(7): 2719-2726.
SONG W J, XIE Y, HUANG W J, et al.A variable pitch control strategy for wind turbines based on improved active disturbance rejection controller[J]. Science technology and engineering, 2020, 20(7): 2719-2726.
[11] 李晶, 宋家骅, 王伟胜. 大型变速恒频风力发电机组建模与仿真[J]. 中国电机工程学报, 2004, 24(6): 100-105.
LI J, SONG J H, WANG W S.Modeling and dynamic simulation of variable speed wind turbine with large capacity[J]. Proceedings of the CSEE, 2004, 24(6): 100-105.
[12] 刘其辉, 贺益康, 赵仁德. 变速恒频风力发电系统最大风能追踪控制[J]. 电力系统自动化, 2003, 27(20): 62-67.
LIU Q H, HE Y K, ZHAO R D.The maximal wind-energy tracing control of avariable-speed constant-frequency wind-power generation system[J]. Automation of electric power systems, 2003, 27(20): 62-67.
[13] 张吉宣, 贾建芳, 戴媛媛. 基于模型补偿的风力机变桨距线性自抗扰控制器设计[J]. 电机与控制应用, 2018, 45(6): 88-94.
ZHANG J X, JIA J F, DAI Y Y.Design of linear active disturbance rejection controller for wind turbine variable pitch system based on model compensation[J]. Electric machines & control application, 2018, 45(6): 88-94.
[14] 韩京清. 自抗扰控制器及其应用[J]. 控制与决策, 1998, 13(1): 19-23.
HAN J Q.Auto-disturbances-rejection controller and its applications[J]. Control and decision, 1998, 13(1): 19-23.
[15] 高志强. 自抗扰控制思想探究[J]. 控制理论与应用, 2013, 30(12): 1498-1510.
GAO Z Q.On the foundation of active disturbance rejection control[J]. Control theory & applications, 2013, 30(12): 1498-1510.
[16] 张建功, 周雪松, 马幼捷, 等. 基于Buck变换器的模糊自抗扰Hopf分岔扰动抑制策略[J]. 电力系统保护与控制, 2023, 51(15): 12-21.
ZHANG J G, ZHOU X S, MA Y J, et al.Fuzzy ADRC Hopf bifurcation disturbance suppression strategy based on a Buck converter[J]. Power system protection and control, 2023, 51(15): 12-21.
[17] 韩永强, 徐明忻, 孙碣, 等. 改进LADRC的储能逆变器直流母线电压控制[J]. 电力系统及其自动化学报, 2021, 33(1): 13-21.
HAN Y Q, XU M X, SUN J, et al.Improved DC bus voltage control of LADRC energy-storage inverter[J]. Proceedings of the CSU-EPSA, 2021, 33(1): 13-21.
[18] 马幼捷, 杨清, 周雪松, 等. 基于级联型扩张状态观测器的直流微电网低压负载接口变换器自抗扰稳压研究[J]. 电力系统保护与控制, 2024, 52(4): 121-132.
MA Y J, YANG Q, ZHOU X S, et al.Active disturbance rejection and voltage regulation of a DC microgrid low voltage load interface converter based on a cascaded extended state observer[J]. Power system protection and control, 2024, 52(4): 121-132.
[19] 袁东, 马晓军, 曾庆含, 等. 二阶系统线性自抗扰控制器频带特性与参数配置研究[J]. 控制理论与应用, 2013, 30(12): 1630-1640.
YUAN D, MA X J, ZENG Q H, et al.Research on frequency-band characteristics and parameters configuration of linear active disturbance rejection control for second-order systems[J]. Control theory & applications, 2013, 30(12): 1630-1640.
[20] 周雪松, 张心茹, 赵浛宇, 等. 基于DDPG算法的微网负载端接口变换器自抗扰控制[J]. 电力系统保护与控制, 2023, 51(21): 66-75.
ZHOU X S, ZHANG X R, ZHAO H Y, et al.Active disturbance rejection control of a microgrid load-side interface converter based on a DDPG algorithm[J]. Power system protection and control, 2023, 51(21): 66-75.
[21] LIANG Y C, GUO C L, DING Z H, et al.Agent-based modeling in electricity market using deep deterministic policy gradient algorithm[J]. IEEE transactions on power systems, 2020, 35(6): 4180-4192.
[22] SEHGAL A, LA H, LOUIS S, et al.Deep reinforcement learning using genetic algorithm for parameter optimization[C]//2019 Third IEEE International Conference on Robotic Computing (IRC). Naples, Italy, 2019: 596-601.
[23] SHI Q, YING W D, LYU L, et al.Deep reinforcement learning-based attitude motion control for humanoid robots with stability constraints[J]. Industrial Robot: the international journal of robotics research and application, 2020, 47(3): 335-347.
[24] 田黄田, 谢源, 施铃丽, 等. 模糊布谷鸟算法在风电机组变桨自抗扰控制中的应用[J]. 太阳能学报, 2021, 42(1): 222-229.
TIAN H T, XIE Y, SHI L L, et al.Application of fuzzy cuckoo search algorithm in active disturbance rejection control of variable pitch of wind turbines[J]. Acta energiae solaris sinica, 2021, 42(1): 222-229.