STUDY ON JOINT CONTROL OF PUMP AND RADIATOR IN PEMFC BASED ON DEEP DETERMINISTIC POLICY GRADIENT

Zhao Hongshan; Pan Sichao; Wu Yuchen; Ma Libo; Lyu Tingyan

doi:10.19912/j.0254-0096.tynxb.2023-0145

PDF(3242 KB)

Acta Energiae Solaris Sinica ›› 2024, Vol. 45 ›› Issue (6) : 92-101. DOI: 10.19912/j.0254-0096.tynxb.2023-0145

STUDY ON JOINT CONTROL OF PUMP AND RADIATOR IN PEMFC BASED ON DEEP DETERMINISTIC POLICY GRADIENT

Zhao Hongshan, Pan Sichao, Wu Yuchen, Ma Libo, Lyu Tingyan

Author information +

History +

Abstract

Aiming at the control problems of water pump and radiator in fuel cell thermal management system, a joint control strategy based on deep deterministic policy gradient （DDPG） was proposed. This strategy replaces the independent controller of the water pump and radiator in the traditional control framework, and uses an intelligent agent with multiple inputs and multiple outputs that can simultaneously control the cooling water flow rate of the water pump and the air flow rate of the radiator. Firstly, the state space and action space of the intelligent agent are determined. Then, the reward function is set by the control goal. Finally, examples are given to verify the effectiveness of the algorithm. The results show that the proposed joint control strategy can effectively control the flow rate of cooling water and air at the same time, thereby improving the operating efficiency of PEMFC.

Key words

deep leaarning / reinforcement learning / proton exchange membrane fuel cells / intelligent control / deep deterministic policy gradient

Cite this article

EndNote

Ris (Procite)

Bibtex

Download Citations

Zhao Hongshan, Pan Sichao, Wu Yuchen, Ma Libo, Lyu Tingyan. STUDY ON JOINT CONTROL OF PUMP AND RADIATOR IN PEMFC BASED ON DEEP DETERMINISTIC POLICY GRADIENT[J]. Acta Energiae Solaris Sinica. 2024, 45(6): 92-101 https://doi.org/10.19912/j.0254-0096.tynxb.2023-0145

References

[1] 姚健, 范伟军, 郭斌, 等. 氢燃料电池性能检测系统设计[J]. 电源技术, 2023, 47(7): 914-917.
YAO J, FAN W J, GUO B, et al.Design of hydrogen fuel cell performance test system[J]. Chinese journal of power sources, 2023, 47(7): 914-917.
[2] 沈伟, 石霖, 陈春光, 等. 多堆燃料电池系统温度模型预测控制[J]. 同济大学学报(自然科学版), 2022, 50(9): 1368-1376.
SHEN W, SHI L, CHEN C G, et al.Analysis of temperature model predictive control of a multi-stack fuel cell system[J]. Journal of Tongji University (natural science), 2022, 50(9): 1368-1376.
[3] 侯健, 杨铮, 贺婷, 等. 质子交换膜燃料电池热管理问题的研究进展[J]. 中南大学学报(自然科学版), 2021, 52(1): 19-30.
HOU J, YANG Z, HE T, et al.Research progress on thermal management of proton exchange membrane fuel cells[J]. Journal of Central South University (science and technology), 2021, 52(1): 19-30.
[4] MA L B, ZHAO H S, QU Y H, et al.Reduced-order active disturbance rejection control method for PEMFC air intake system based on the estimation of oxygen excess ratio[J]. IET renewable power generation, 2023, 17(4): 951-963.
[5] 陈梦萍, 任建兴, 李芳芹. 风光互补与电解水制氢系统负荷的协调稳定运行[J]. 太阳能学报, 2023, 44(3): 344-350.
CHEN M P, REN J X, LI F Q.Coordinated and stable operation of wind solar complementarity and load of electrolytic water hydrogen production system[J]. Acta energiae solaris sinica, 2023, 44(3): 344-350.
[6] BAROUTAJI A, WILBERFORCE T, RAMADAN M, et al.Comprehensive investigation on hydrogen and fuel cell technology in the aviation and aerospace sectors[J]. Renewable and sustainable energy reviews, 2019, 106: 31-40.
[7] 李勇霞, 段立强, 潘盼, 等. 基于太阳能热驱动甲烷重整制氢的燃料电池发电系统性能研究[J]. 太阳能学报, 2022, 43(9): 131-138.
LI Y X, DUAN L Q, PAN P, et al.Performance research of fuel cell power generation system based on solar thermal driven methane reforming for hydrogen production[J]. Acta energiae solaris sinica, 2022, 43(9): 131-138.
[8] 赵杰, 李文浩, 杜常清, 等. 不同操作和环境条件下的PEMFC低温冷启动数值模拟研究[J]. 太阳能学报, 2022, 43(6): 460-466.
ZHAO J, LI W H, DU C Q, et al.Numerical simulation study of low temperature cold start of PEMFC under different operating and environmental conditions[J]. Acta energiae solaris sinica, 2022, 43(6): 460-466.
[9] 徐展, 魏蔚, 许春华, 等. 面向车载深冷高压供氢系统的控制策略研究[J]. 太阳能学报, 2021, 42(5): 32-38.
XU Z, WEI W, XU C H, et al.Research on control strategy for on-board cryo-compressed hydrogen supply system[J]. Acta energiae solaris sinica, 2021, 42(5): 32-38.
[10] 金红超, 何锋, 胡耀宗. 基于变论域模糊理论的PEMFC热管理系统控制研究[J]. 电子测量技术, 2022, 45(14): 23-28.
JIN H C, HE F, HU Y Z.Thermal management system control of PEMFC based on variable universe fuzzy theory[J]. Electronic measurement technology, 2022, 45(14): 23-28.
[11] CHEN Y, PI D C, WANG B, et al.Bi-subgroup optimization algorithm for parameter estimation of a PEMFC model[J]. Expert systems with applications, 2022, 196: 116646.
[12] 李春华, 朱新坚. 基于递归模糊神经网络的PEMFC温度控制研究[J]. 热能动力工程, 2012, 27(6): 721-725, 741-742.
LI C H, ZHU X J. Study of the temperature control of a proton exchange membrane fuel cell(PEMFC) based on a regressive fuzzy neural network[J]. Journal of engineering for thermal energy and power, 2012, 27(6): 721-725, 741-742.
[13] HU P, CAO G Y, ZHU X J, et al.Coolant circuit modeling and temperature fuzzy control of proton exchange membrane fuel cells[J]. International journal of hydrogen energy, 2010, 35(17): 9110-9123.
[14] O'KEEFE D, EL-SHARKH M Y, TELOTTE J C, et al. Temperature dynamics and control of a water-cooled fuel cell stack[J]. Journal of power sources, 2014, 256: 470-478.
[15] LI D Z, LI C, GAO Z Q, et al.On active disturbance rejection in temperature regulation of the proton exchange membrane fuel cells[J]. Journal of power sources, 2015, 283: 452-463.
[16] 陈维荣, 牛茁, 韩喆, 等. 水冷PEMFC热管理系统流量跟随控制策略[J]. 化工学报, 2017, 68(4): 1490-1498.
CHEN W R, NIU Z, HAN Z, et al.Flow following control strategy for thermal management of water-cooled PEMFC[J]. CIESC journal, 2017, 68(4): 1490-1498.
[17] LISO V, NIELSEN M P, KÆR S K, et al. Thermal modeling and temperature control of a PEM fuel cell system for forklift applications[J]. International journal of hydrogen energy, 2014, 39(16): 8410-8420.
[18] HUANG L H, CHEN J, LIU Z Y, et al.Adaptive thermal control for PEMFC systems with guaranteed performance[J]. International journal of hydrogen energy, 2018, 43(25): 11550-11558.
[19] 赵洪波, 刘杰, 马彪, 等. 水冷PEMFC热管理系统控制策略及仿真研究[J]. 化工学报, 2020, 71(5): 2139-2150.
ZHAO H B, LIU J, MA B, et al.Control strategy and simulation research of water-cooled PEMFC thermal management system[J]. CIESC journal, 2020, 71(5): 2139-2150.
[20] REN Y, CAO G Y, ZHU X J.Particle swarm optimization based predictive control of proton exchange membrane fuel cell (PEMFC)[J]. Journal of Zhejiang University-science A, 2006, 7(3): 458-462.
[21] 赵振瑞, 欧阳惠颖, 田国富, 等. 基于模糊逻辑与遗传算法的燃料电池热管理方法研究[J]. 集成技术, 2021, 10(3): 35-46.
ZHAO Z R, OUYANG H Y, TIAN G F, et al.Research on thermal management method of fuel cell based on fuzzy logic and genetic algorithm[J]. Journal of integration technology, 2021, 10(3): 35-46.
[22] YE M, WANG X, XU Y.Parameter identification for proton exchange membrane fuel cell model using particle swarm optimization[J]. International journal of hydrogen energy, 2009, 34(2): 981-989.
[23] YUAN Z, WANG W Q, WANG H Y, et al.Parameter identification of PEMFC based on convolutional neural network optimized by balanced Deer hunting optimization algorithm[J]. Energy reports, 2020, 6: 1572-1580.
[24] 李璀璀, 易文俊, 管军, 等. 基于遗传算法的电动舵机系统模糊PID控制[J]. 兵器装备工程学报, 2021, 42(3): 162-167.
LI C C, YI W J, GUAN J, et al.Fuzzy PID control of electromechanical actuator system based on genetic algorithm[J]. Journal of ordnance equipment engineering, 2021, 42(3): 162-167.