Vehicle logo recognition method based on feature enhancement
- Vol. 26, Issue 5, Pages: 1030-1040(2021)
Received:23 June 2020,
Revised:2020-8-31,
Accepted:07 September 2020,
Published:16 May 2021
DOI: 10.11834/jig.200327
移动端阅览

浏览全部资源
扫码关注微信
Received:23 June 2020,
Revised:2020-8-31,
Accepted:07 September 2020,
Published:16 May 2021
移动端阅览
目的
2
小样本情况下的车标识别在实际智能交通系统中具有十分重要的应用价值。针对从实际监控系统中获取的车标图像低分辨率、低质量的特点,考虑如何从车标结构相似性、局部显著特征方面来对车标的整体特征进行增强,提出一种特征增强策略驱动下的车标识别方法(vehicle logo recognition method based on feature enhancement,FE-VLR)。
方法
2
提取车标图像的自对称相似特征,构建图像金字塔,在每层金字塔下提取车标的整体特征和局部显著特征,其中局部显著区域通过基于邻域块相关度的显著区域检测来获取,最后结合CRC(collaborative representation based classification)分类器对车标进行分类识别。
结果
2
在公开车标数据集HFUT-VL(Vehicle Logo Dataset from Hefei University of Technology)和XMU(Xiamen University Vehicle Logo Dataset)上对算法效果进行评估,实验结果表明,在小样本情况下,本文方法优于其他一些传统的车标识别方法,且与一些基于深度学习模型的方法相比,其识别率也有所提升。在HFUT-VL数据集上,当训练样本数为5时,识别率达到97.78%;当训练样本数为20时,识别率为99.1%。在更为复杂的XMU数据集上,本文方法表现出了更好的有效性和更强的鲁棒性,当训练样本在15幅及以下时,本文方法与具有较好表现的OE-POEM(overlapping enhanced patterns of oriented edge magnitudes)算法相比至少提升了7.2%。
结论
2
本文提出的基于特征增强策略的车标识别方法,通过融合自对称相似特征、局部显著特征和车标整体特征来增强特征的表达,提高了对实际道路中的低质量、低分辨率车标图像的识别能力,更能满足实际应用中对车标识别的需求。
Objective
2
With the rapid development of computer vision technology
the demand for intelligent and humanized transportation systems is gradually increasing. Vehicle logo recognition (VLR) is an important part of intelligent transportation systems
and the requirements for its recognition effect are gradually increasing. Considering the difficulty in achieving the samples of some vehicle logos from real surveillance systems in certain areas and the cost of collecting samples and training
the recognition of vehicle logos under small training samples still has very important application value. Vehicle logos captured from real surveillance systems on the road suffer from the following characteristics: 1) low resolution
2) easy to blur due to the movement of vehicles
and 3) easily influenced by light from the environment. Thus
the recognition of vehicle logos is still a challenging problem. Given the fact that some vehicle logos have similar structures and part of the vehicle logos has salient features
we consider how to enhance the overall characteristics of vehicle logos from the aspects of symmetrical structural and local saliency
which can benefit VLR
and propose a VLR method based on feature enhancement
called feature enhancement-based vehicle logo recognition (FE-VLR).
Method
2
FE-VLR comprehensively considers the structural similarity features and local salient features of the vehicle logo and then combines them together with the overall features of the vehicle logo to identify the vehicle logo. Based on the analysis of the structural symmetry of the left and right parts of the vehicle logo
this study calculates the similarity value of the image block to express the similarity feature. In addition
a method for calculating salient regions based on the correlation of neighborhood blocks is proposed to locate and extract the salient features of the vehicle logo. First
it extracts similar self-symmetrical features of vehicle logo images and then builds an image pyramid. Under each layer of the pyramid
the overall features and local salient features of the vehicle logos are extracted. Local salient locations are obtained by salient region detection based on the correlation of neighborhood blocks. Finally
a collaborative representation-based classification (CRC) classifier is used to classify the vehicle logos. CRC is a fast and effective classifier suitable for small training samples. The classifier uses the collaborative coding of all samples in the sample dictionary to represent the prediction samples
so as to improve the recognition rate by using the difference of the same attribute between different types of vehicle logos.
Result
2
The effectiveness of our algorithm is evaluated on the public vehicle logo datasets Vehicle Logo Dataset from Hefei University of Technology (HFUT-VL) and Xiamen University Vehicle Logo Dataset (XMU). The experimental results show that under small training samples
FE-VLR is superior to some other traditional VLR methods and also has higher recognition rates than some convolutional neural network-based methods. On the HFUT-VL dataset
when the number of training samples is 5
the recognition rate of FE-VLR reaches 97.78%
and when the number of training samples is 20
the recognition rate reaches 99.1%. On the more complex XMU dataset
FE-VLR is more efficient and robust. When the number of training samples is equal or less than 15
FE-VLR can improve the recognition rate by at least 7.2% compared with overlapping enhanced patterns of oriented edge magnitudes(OE-POEM). The experimental results show that FE-VLR always has better performance under small samples.
Conclusion
2
The FE-VLR method increases the recognition ability of low-quality and low-resolution vehicle logo images obtained from real surveillance systems on the road
which can better meet the needs of VLR in practical applications. The experimental results on the public HFUT-VL and XMU datasets show that in case of small samples
the recognition rate of FE-VLR is higher than that of other VLR methods and better than some recognition methods based on deep learning models.
Burkhard T, Minich A J and Li C. 2011. Vehicle logo recognition and classification: feature descriptors vs. shape descriptors[EB/OL]. [2021-04-23] . https://stacks.stanford.edu/file/druid:my512gb2187/Burkhard_Li_Minich_Automated_Vehicle_Identification.pdf https://stacks.stanford.edu/file/druid:my512gb2187/Burkhard_Li_Minich_Automated_Vehicle_Identification.pdf
Chen R, Hawes M B and Mihaylova L. 2016. Vehicle logo recognition by spatial-SIFT combined with logistic regression[EB/OL]. [2020-06-01] . http://eprints.whiterose.ac.uk/99743/1/PID4139805.pdf http://eprints.whiterose.ac.uk/99743/1/PID4139805.pdf
Huang C X, Liang B B, Li W and Han S C. 2017. A convolutional neural network architecture for vehicle logo recognition//Proceedings of 2017 IEEE International Conference on Unmanned Systems (ICUS). Beijing, China: IEEE: 282-287[ DOI: 10.1109/ICUS.2017.8278355 http://dx.doi.org/10.1109/ICUS.2017.8278355 ]
Huang Y, Wu R W, Sun Y, Wang W and Ding X H. 2015. Vehicle logo recognition system based on convolutional neural networks with a pretraining strategy. IEEE Transactions on Intelligent Transportation Systems, 16(4): 1951-1960[DOI:10.1109/TITS.2014.2387069]
Huang Z J, Fu M X, Ni K L, Sun H and Sun S L. 2018a. Recognition of vehicle-logo based on faster-RCNN//Proceedings of the 4th International Conference on Signal and Information Processing, Networking and Computers. Yuzhou, China: Springer: 75-83[ DOI: 10.1007/978-981-13-1733-0_10 http://dx.doi.org/10.1007/978-981-13-1733-0_10 ]
Huang Z L, Lu X B and Chen C. 2018b. A vehicle logo recognition method based on improved SIFT feature and bag-of-words model//Proceedings Volume 10806, 10th International Conference on Digital Image Processing (ICDIP 2018). Shanghai, China: SPIE: 545-551[ DOI: 10.1117/12.2502972 http://dx.doi.org/10.1117/12.2502972 ]
Li X Y, Teng H and Cao M M. 2016. Vehicle logo recognition based on optimized dictionary and robust collaborative representation//Proceedings of 2016 International Conference on Information Engineering and Communications Technology. Shanghai, China: Adv Sci Res Ctr: 132-137[ DOI: 10.12783/dtetr/iect2016/3726 http://dx.doi.org/10.12783/dtetr/iect2016/3726 ]
Liu H M, Huang Z C and Talab A M A. 2015. Patch-based vehicle logo detection with patch intensity and weight matrix. Journal of Central South University,22(12): 4679-4686[DOI:10.1007/s11771-015-3018-4]
Llorca D F, Arroyo R and Sotelo M A. 2013. Vehicle logo recognition in traffic images using HOG features and SVM//Proceedings of the 16th International IEEE Conference on Intelligent Transportation Systems. The Hague, Netherlands: IEEE: 2229-2234[ DOI: 10.1109/ITSC.2013.6728559 http://dx.doi.org/10.1109/ITSC.2013.6728559 ]
Ou Y C, Zheng H C, Chen S Y and Chen J T. 2014. Vehicle logo recognition based on a weighted spatial pyramid framework//Proceedings of 17th International IEEE Conference on Intelligent Transportation Systems (ITSC). Qingdao, China: IEEE: 1238-1244[ doi: 10.1109/ITSC.2014.6957857 http://dx.doi.org/10.1109/ITSC.2014.6957857 ]
Peng H Y, Wang X, Wang H Y and Yang W W. 2015. Recognition of low-resolution logos in vehicle images based on statistical random sparse distribution. IEEE Transactions on Intelligent Transportation Systems, 16(2): 681-691[DOI:10.1109/TITS.2014.2336675]
Psyllos A, Anagnostopoulos C N and Kayafas E. 2012. M-SIFT: a new method for vehicle logo recognition//Proceedings of 2012 IEEE International Conference on Vehicular Electronics and Safety. Istanbul, Turkey: IEEE: 261-266[ DOI: 10.1109/ICVES.2012.6294277 http://dx.doi.org/10.1109/ICVES.2012.6294277 ]
Soon F C, Khaw H Y, Chuah J H and Kanesan J. 2019. Vehicle logo recognition using whitening transformation and deep learning. Signal, Image and Video Processing, 13(1): 111-119[DOI:10.1007/s11760-018-1335-4]
Sun Q, Lu X B, Chen L and Hu H H. 2014. An improved vehicle logo recognition method for road surveillance images//Proceedings of the 7th International Symposium on Computational Intelligence and Design. Hangzhou, China: IEEE: 373-376[ DOI: 10.1109/ISCID.2014.12 http://dx.doi.org/10.1109/ISCID.2014.12 ]
Vu N S and Caplier A. 2012. Enhanced patterns of oriented edge magnitudes for face recognition and image matching. IEEE Transactions on Image Processing, 21(3): 1352-1365[DOI:10.1109/TIP.2011.2166974]
Yu S Y, Zheng S B, Yang H and Liang L F. 2013. Vehicle logo recognition based on bag-of-words//Proceedings of the 10th IEEE International Conference on Advanced Video and Signal Based Surveillance. Krakow, Poland: IEEE: 353-358[ DOI: 10.1109/AVSS.2013.6636665 http://dx.doi.org/10.1109/AVSS.2013.6636665 ]
Yu Y, Nie Z X, Jin Q and Wang J M. 2016. Vehicle logo recognition based on randomly sampled pixel-pair feature from foreground-background skeleton areas. Journal of Image and Graphics, 21(10): 1348-1356
余烨, 聂振兴, 金强, 王江明. 2016. 前背景骨架区域随机点对策略驱动下的车标识别方法. 中国图象图形学报, 21(10): 1348-1356[DOI:10.11834/jig.20161009]
Yu Y, Wang J, Lu J T, Xie Y and Nie Z X. 2018. Vehicle logo recognition based on overlapping enhanced patterns of oriented edge magnitudes. Computers and Electrical Engineering, 71: 273-283[DOI:10.1016/j.compeleceng.2018.07.045]
Yu Y, Xu J T, He M X and Lu Q. 2019. Vehicle logo recognition based on local quantization of enhanced edge gradient features. Journal of Image and Graphics, 24(9): 1458-1471
余烨, 徐京涛, 贺敏雪, 路强. 2019. 增强边缘梯度特征局部量化策略驱动下的车标识别. 中国图象图形学报, 24(9): 1458-1471[DOI:10.11834/jig.180638]
相关文章
相关作者
相关机构
京公网安备11010802024621