基于改进DeepLabv3+的含噪声热红外图像光伏热斑检测方法

doi:10.19912/j.0254-0096.tynxb.2022-1048

太阳能学报 ›› 2023, Vol. 44 ›› Issue (11): 23-30.DOI: 10.19912/j.0254-0096.tynxb.2022-1048

基于改进DeepLabv3+的含噪声热红外图像光伏热斑检测方法

陈辉¹, 张傲¹, 孙帅¹, 梁维斌², 黄和平³

1.上海电力大学自动化工程学院,上海 200090;
2.上海燧原科技有限公司,上海 201203;
3.浙江正泰仪器仪表有限责任公司,杭州 310052

收稿日期:2022-07-15 出版日期:2023-11-28 发布日期:2024-05-28
通讯作者: 陈辉（1982—）,女,博士、副教授、硕士生导师,主要从事机器视觉与模式识别、机器人导航与地图构建SLAM、电力设备状态检测、电厂信息化三维重建等方面的研究。chenhui@shiep.edu.cn
基金资助:
上海市自然科学基金面上项目（20ZR1421300）; 上海市浦江（D类）人才计划（21PJD025）; 上海市科委创新行动科技支撑碳达峰碳中和（21DZ1207300）; 国家科技部外国专家局项目（DL2022013007L)

PHOTOVOLTAIC THERMAL SPOT DETECTION METHOD WITH NOISY THERMAL INFRARED IMAGE BASED ON IMPROVED DEEPLABV3+

Chen Hui¹, Zhang Ao¹, Sun Shuai¹, Liang Weibin², Huang Heping³

1. School of Automation Engineering, Shanghai University of Electric Power, Shanghai 200090, China;
2. Shanghai Enflame Technology Co., Ltd., Shanghai 201203, China;
3. Zhengtai Instrument （Hangzhou） Co., Ltd., Hangzhou 310052, China

Received:2022-07-15 Online:2023-11-28 Published:2024-05-28

摘要/Abstract

摘要： 光伏组件表面钢化玻璃会导致采集的热红外图像中带有反光噪声, 其与热斑的特征相似,热斑检测中常出现误检。该文提出一种多尺度融合注意力机制的轻量化DeepLabv3+语义分割模型LD-MA（lightweight DeepLabv3+ with multi-scale integrated attention mechanism）用于热斑检测。LD-MA基于DeepLabv3+网络架构,首先引用MobileNetV2作为主干特征提取网络,减小网络参数量以提高训练效率。然后设计多尺度特征融合模块并引入CBAM注意力机制,保留多阶段目标特征且强化对热斑目标特征信息和位置信息的学习。在自建光伏热斑数据集进行热斑检测实验,结果表明LD-MA模型参数量大幅减少,同时有效避免误检和漏检,在测试集中平均交并比（mIoU）和类别平均像素准确率（mPA）分别达到90.82%和94.39%。

关键词: 光伏组件, 故障检测, 语义分割, 热斑, 反光噪声

Abstract: The tempered glass on the surface of photovoltaic modules will cause reflection noise in the collected thermal infrared images, which is similar to the characteristics of hot spots, which will often leads false detections in hot spot detection task. This paper proposes a lightweight DeepLabv3+ semantic segmentation model called LD-MA （Lightweight DeepLabv3+ with Multi-scale integrated Attention Mechanism） for hot spot detection. LD-MA is based on the DeepLabv3+ network architecture, First, MobileNetV2 is used as the backbone feature extraction network to reduce the amount of network parameters to improve training efficiency. Then, a multi-scale feature fusion module is designed and a CBAM attention mechanism is introduced to retain the multi-stage target features and strengthen the learning of hot spot target feature information and location information. The hot spot detection experiment was carried out on the self-built photovoltaic hot spot data set, and the results showed that the parameters of the LD-MA model were greatly reduced, and at the same time, false detection and missed detection were effectively avoided. In the test set, mIoU and mPA reached 90.82% and 94.39%.

Key words: PV modules, fault detection, semantic segmentation, hot spot, reflection noise

中图分类号:

TN219

陈辉, 张傲, 孙帅, 梁维斌, 黄和平. 基于改进DeepLabv3+的含噪声热红外图像光伏热斑检测方法[J]. 太阳能学报, 2023, 44(11): 23-30.

Chen Hui, Zhang Ao, Sun Shuai, Liang Weibin, Huang Heping. PHOTOVOLTAIC THERMAL SPOT DETECTION METHOD WITH NOISY THERMAL INFRARED IMAGE BASED ON IMPROVED DEEPLABV3+[J]. Acta Energiae Solaris Sinica, 2023, 44(11): 23-30.

参考文献

[1] KIM K A, SEO G S, CHO B H, et al.Photovoltaic hot-spot detection for solar panel substrings using AC parameter characterization[J]. IEEE transactions on power electronics, 2016, 31(2): 1121-1130.
[2] 陈功, 蔡磊, 张琳, 等. 光伏热斑模拟建模及热成像分析[J]. 电子测量与仪器学报, 2021, 35(8): 191-197.
CHEN G, CAI L, ZHANG L, et al.Photovoltaic hotspot simulation modeling and thermal imaging analysis[J]. Journal of electronic measurement and instrumentation, 2021, 35(8): 191-197.
[3] 蒋琳, 苏建徽, 施永, 等. 基于红外热图像处理的光伏阵列热斑检测方法[J]. 太阳能学报, 2020, 41(8): 180-184.
JIANG L, SU J H, SHI Y, et al.Hot spots detection of operating PV arrays through IR thermal image[J]. Acta energiae solaris sinica, 2020, 41(8): 180-184.
[4] 陈文勤, 郝慧杰, 肖建, 等. 一种高精度的光伏阵列红外图像分割算法[J]. 计算机技术与发展, 2020, 30(11): 153-157.
CHEN W Q, HAO H J, XIAO J, et al.A high-precision photovoltaic array infrared image segmentation algorithm[J]. Computer technology and development, 2020, 30(11): 153-157.
[5] LIU W, ANGUELOV D, ERHAN D, et al.SSD: single shot MultiBox detector[C]//European Conference on Computer Vision. Cham: Springer, 2016: 21-37.
[6] REDMON J, DIVVALA S, GIRSHICK R, et al.You only look once: unified, real-time object detection[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, NV, USA, 2016: 779-788.
[7] BADRINARAYANAN V, KENDALL A, CIPOLLA R.SegNet: a deep convolutional encoder-decoder architecture for image segmentation[J]. IEEE transactions on pattern analysis and machine intelligence, 2017, 39(12): 2481-2495.
[8] ZHAO H S, SHI J P, QI X J, et al.Pyramid scene parsing network[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu, HI, USA, 2017: 6230-6239.
[9] CHEN L C, PAPANDREOU G, KOKKINOS I, et al.DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs[J]. IEEE transactions on pattern analysis and machine intelligence, 2018, 40(4): 834-848.
[10] RONNEBERGER O, FISCHER P, BROX T.U-net: convolutional networks for biomedical image segmentation[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention. Cham: Springer, 2015: 234-241.
[11] ALI M U, KHAN H F, MASUD M, et al.A machine learning framework to identify the hotspot in photovoltaic module using infrared thermography[J]. Solar energy, 2020, 208: 643-651.
[12] REN Y F, YU Y J, LI J, et al.Design of photovoltaic hot spot detection system based on deep learning[J]. Journal of physics: conference series, 2020, 1693(1): 012075.
[13] SU B Y, CHEN H Y, LIU K, et al.RCAG-net: residual channelwise attention gate network for hot spot defect detection of photovoltaic farms[J]. IEEE transactions on instrumentation and measurement, 2021, 70: 1-14.
[14] 王道累, 李超, 李明山, 等. 基于深度卷积神经网络的光伏组件热斑检测[J]. 太阳能学报, 2022, 43(1): 412-417.
WANG D L, LI C, LI M S, et al.Solar photovoltaic modules hot spot detection based on deep convolutional neural networks[J]. Acta energiae solaris sinica, 2022, 43(1): 412-417.
[15] 魏缪宇, 卫东, 郭倩, 等. 局部异物遮挡状态下光伏单元输出特性与故障诊断方法[J]. 太阳能学报, 2021, 42(5): 260-266.
WEI M Y, WEI D, GUO Q, et al.Output characteristics and fault diagnosis method of PV unit under partial shading[J]. Acta energiae solaris sinica, 2021, 42(5): 260-266.
[16] 陈宗阳, 赵辉, 吕永胜, 等. 基于改进MobileNetV2网络的涂层表面缺陷识别方法[J]. 哈尔滨工程大学学报, 2022, 43(4): 572-579.
CHEN Z Y, ZHAO H, LYU Y S, et al.A recognition method of coating surface defects based on the improved MobileNetV2 network[J]. Journal of Harbin Engineering University, 2022, 43(4): 572-579.
[17] SANDLER M, HOWARD A, ZHU M L, et al.MobileNetV2: inverted residuals and linear bottlenecks[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City, UT, USA, 2018: 4510-4520.
[18] WOO S, PARK J, LEE J Y, et al.CBAM: convolutional block attention module[C]//European Conference on Computer Vision. Cham: Springer, 2018: 3-19.
[19] GUINDON B, ZHANG Y.Application of the dice coefficient to accuracy assessment of object-based image classification[J]. Canadian journal of remote sensing, 2017, 43(1): 48-61.

编辑推荐 0

Metrics

阅读次数

全文

HTML			PDF

最新录用	在线预览	正式出版	最新录用	在线预览	正式出版
0	0	0	0	0	36

	来源	本网站

	次数	36
	比例	100%

摘要

249

最新录用	在线预览	正式出版

0	0	249

	来源	本网站

	次数	250
	比例	100%

基于改进DeepLabv3+的含噪声热红外图像光伏热斑检测方法

PHOTOVOLTAIC THERMAL SPOT DETECTION METHOD WITH NOISY THERMAL INFRARED IMAGE BASED ON IMPROVED DEEPLABV3+

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐 0

Metrics

[1]	韩硕, 胡坚柯, 韩一峰, 王军, 王乐, Lund Peter. 双面光伏组件建模及发电性能研究[J]. 太阳能学报, 2023, 44(9): 94-100.
[2]	王银, 高瑞泽, 李茂环, 孙前来, 李小松, 胡啸. 基于YOLOv5 LiteX算法的光伏组件缺陷检测[J]. 太阳能学报, 2023, 44(9): 101-108.
[3]	孙海蓉, 李莉, 周映杰, 周黎辉. 基于特征金字塔融合高分辨率网络的光伏热斑识别[J]. 太阳能学报, 2023, 44(9): 109-116.
[4]	谢七月, 孙武彪, 申忠利, 周育才. 基于灰度聚类的光伏红外热斑图像分割方法[J]. 太阳能学报, 2023, 44(9): 117-124.
[5]	顾鑫磊, 顾志伟, 卫东, 周光乐, 郭倩. 基于时间序列波形特征的光伏组串热斑故障诊断方法[J]. 太阳能学报, 2023, 44(9): 125-133.
[6]	高淑萍, 左俊杰, 宋国兵, 沈渠旺, 李元泽. 基于电流故障分量变化特征的三端柔性直流配电网线路保护方法[J]. 太阳能学报, 2023, 44(8): 139-148.
[7]	任惠, 夏静, 卢锦玲, 王允哲, 辛国雨. 基于红外图像和改进MobileNet-V3的光伏组件故障诊断方法[J]. 太阳能学报, 2023, 44(8): 238-245.
[8]	郑隽卿, 罗勇, 常蕊, 高晓清. 大规模光伏开发对局地气候生态影响研究[J]. 太阳能学报, 2023, 44(8): 253-265.
[9]	邓炎, 龚赞, 武立康, 姚尧, 郑梓敏, 刘益才. 基于设备互补特性的冷热电系统优化[J]. 太阳能学报, 2023, 44(7): 88-95.
[10]	王乐, 陈雪, 张舒, 王法泽, 王军. 光伏组件热斑效应研究[J]. 太阳能学报, 2023, 44(7): 155-161.
[11]	陈伟, 雷欢, 裴婷婷, 李旭斌. 基于退化轨迹和Wiener模型的光伏组件剩余寿命预测方法[J]. 太阳能学报, 2023, 44(7): 175-181.
[12]	汪德成, 李妍, 张群, 王思茗, 许波, 陈振乾. 冷热电储一体化综合能源系统优化研究[J]. 太阳能学报, 2023, 44(6): 130-136.
[13]	高瑜, 康兴国, 周少迪, 冯小静, 王寅清, 孔晓龙. 基于改进BES-LSSVM光伏组件积灰预测[J]. 太阳能学报, 2023, 44(6): 213-219.
[14]	赵明智, 冯绍东, 段佩瑶, 董江硕, 刘鑫, 胡小明. 雾霾对光伏组件输出特性的影响研究[J]. 太阳能学报, 2023, 44(6): 220-226.
[15]	朱冰洁, 宋昊, 陈昊旻, 怀朝君, 胡旦, 何一峰. 不同温度条件下晶体硅光伏组件光/电致衰减[J]. 太阳能学报, 2023, 44(6): 227-233.