Current Issue Cover
结合Faster R-CNN的多类型火焰检测

回天, 哈力旦·阿布都热依木, 杜晗(新疆大学电气工程学院, 乌鲁木齐 830047)

摘 要
目的 火焰检测可有效防止火灾的发生。针对目前火焰检测方法,传统图像处理技术的抗干扰能力差、泛化性不强,检测效果对数据波动比较敏感;机器学习方法需要根据不同的场景设定并提取合适火焰的特征,过程比较繁琐。为此提出一种基于Faster R-CNN的多类型火焰检测方法,避免复杂的人工特征提取工作,在面对复杂背景、光照强度变化和形态多样的火焰图像时依然保证较好的检测精度。方法 基于深度学习的思想,利用卷积神经网络自动学习获取图像特征。首先,利用自建数据集构建视觉任务。根据火焰的尖角特性、直观形态和烟雾量等,将火焰类数据划分为单尖角火焰、多尖角火焰和无规则火焰3类。此外,通过深度网络特征可视化实验发现,人造光源与火焰在轮廓上具有一定的相似性,为此建立了人造光源圆形和方形两个数据集作为干扰项来保证检测模型的稳定性;然后,细化训练参数并调整预训练的卷积神经网络结构,改动分类层以满足特定视觉任务。将经过深度卷积神经网络中卷积层和池化层抽象得到的图像特征送入区域生成网络进行回归计算,利用迁移学习的策略得到每一类目标物体相应的探测器;最后,得到与视觉任务相关的目标检测模型,保存权重和偏置参数。并联各类目标物体的子探测器作为整体探测器使用,检测时输出各类探测器的分数,得分最高的视为正确检测项。结果 首先,利用训练好的各探测器与相应测试集样本进行测试,然后,再利用各类目标物的测试集来测试其他类探测器的检测效果,以此证明各探测器之间的互异性。实验结果表明,各类探测器都具有较高的专一性,大大降低了误判的可能性,对于形变剧烈和复杂背景的火焰图像也具有良好的检测准确率。训练得到的检测模型在应对小目标、多目标、形态多样、复杂背景和光照变化等检测难度较大的情况时,均能获得很好的效果,测试集结果表明各类探测器的平均准确率提高了3.03% 8.78%不等。结论 本文提出的火焰检测方法,通过挖掘火焰的直观形态特征,细分火焰类别,再利用深度卷积神经网络代替手动特征设置和提取过程,结合自建数据集和根据视觉任务修改的网络模型训练得到了检测效果良好的多类型火焰检测模型。利用深度学习的思想,避免了繁琐的人工特征提取工作,在得到较好的检测效果的同时,也保证了模型具有较强的抗干扰能力。本文为解决火焰检测问题提供了更加泛化和简洁的解决思路。
关键词
Multi-type flame detection combined with Faster R-CNN

Hui Tian, Halidan·Abudureyimu, Du Han(School of Electrical Engineering, Xinjiang University, Urumqi 830047, China)

Abstract
Objective Flame detection can effectively prevent the occurrence of fire. Traditional image processing techniques for current flame detection methods have low anti-interference ability and generalization, and the detection effect is highly sensitive to data fluctuations. Machine learning must set and extract the characteristics of a suitable flame on the basis of different scenarios, and this process is complex. To avoid complex artificial feature extraction and ensure good detection accuracy in the presence of complex backgrounds, lighting changes, and various forms of flame images, a multi-type flame detection method based on Faster R-CNN was proposed. Method This method is based on deep learning and uses convolutional neural networks to automatically learn to acquire image features. First, visual tasks were established using self-built datasets. According to the sharp angle characteristics of the fire, the visual shape, and the amount of smoke, the flame data were divided into three types, namely, single point, multi-point, and shapeless flames. In addition, in-depth network feature visualization experiments revealed that the artificial light source and the flame have similarities in contour. Thus, two datasets of artificial light sources (circular and square) were established as interference items to ensure the stability of the detection model. Then, the training parameters were refined, and the pre-trained convolutional neural network structure was adjusted. The classification layer was modified to satisfy specific visual tasks. The image features abstracted by the convolutional and pooling layers in the deep convolutional neural network were sent to the region proposal network for regression calculation, and the corresponding detectors for each type of target object were obtained by transfer learning strategy. Finally, the target detection model based on the visual tasks was obtained, and the weights and bias parameters were saved. The sub-detectors of various target objects in parallel were used as the overall detector. The scores of various detectors were output during the detection, and the highest score was considered the correct detection item. Result First, the trained detectors and the corresponding test dataset were used for testing. Then, the test sets of various targets were utilized to test the detection effect of other types of detectors to prove the mutuality between detectors. The experiments demonstrated that all kinds of detectors had a high specificity, which greatly reduced the possibility of misjudgment, and good detection accuracy for flame images with sharp deformations and complex backgrounds. The detection model obtained through training achieved good results when dealing with difficult situations, such as small targets, multiple targets, various forms, complex backgrounds, and lighting changes. The results showed that the average accuracy of various types of detectors increased between 3.03% and 8.78%. Conclusion The proposed flame detection method subdivided the flame category by excavating the visual morphological characteristics of the flame and using the deep convolutional neural network instead of manual feature setting and extraction process. By combining self-built datasets and network models that were modified based on visual tasks, a multi-type flame detection model with good detection results was obtained. By using the concept of deep learning, the tedious artificial feature extraction is avoided, and a good detection effect, is achieved. In addition, the model has a strong anti-interference ability. This article provides a more general and concise solution to the problem of flame detection.
Keywords

订阅号|日报