Vehicle logo recognition based on anti-blur feature extraction

Minxue He; Ye Yu; Jingtao Xu; Qiang Lu

doi:10.11834/jig.190281

Column of CACIS 2019 | Views : 0 下载量: 4 CSCD: 1

PDF
Export
Share
Collection
Album

Vehicle logo recognition based on anti-blur feature extraction
Vol. 25, Issue 3, Pages: 605-617(2020)
Received：21 June 2019，

Revised：2019-8-29，

Accepted：05 September 2019，

Published：16 March 2020
DOI： 10.11834/jig.190281
稿件说明：

移动端阅览

DOI：

Minxue He, Ye Yu, Jingtao Xu, Qiang Lu. Vehicle logo recognition based on anti-blur feature extraction[J]. Journal of Image and Graphics, 2020, 25(3): 605-617. DOI： 10.11834/jig.190281.

摘要

目的

现有的车标识别方法尽管取得了不错的识别效果，但最终的识别率容易遇到瓶颈，很难得到提升。车标识别是智能交通系统中至关重要的一部分，识别率的微小提升也能带来巨大的社会价值。通过挖掘与分析车标识别中潜在的问题和难点，发现未能得到正确分类的图像大部分为模糊车标图像。针对车标图像中存在的成像模糊等情况，本文提出一种基于抗模糊特征提取的车标识别方法。

方法

构建车标图像金字塔模型，分别提取图像的抗纹理模糊特征和抗边缘模糊特征。抗纹理模糊特征的提取使用局部量化的LPQ（local phase quantization）模式，可以增强原始特征的鲁棒性，抗边缘模糊特征的提取基于局部块弱梯度消除的HOG（histogram of oriented gradient）特征提取方法，可以在描述车标图像边缘梯度信息的同时，提升特征的抗模糊能力。最后利用CCA（canonical correlation analysis）方法进行两种抗模糊特征的融合并用于后续的降维与分类。

结果

本文方法在多个数据集上均取得了很好的识别效果，在20幅训练样本下，本文方法在公开车标数据集HFUT-VL（vehicle logo dataset from Hefei University of Technology）上取得了99.04%的识别率，在本文构建的模糊车标数据集BVL（blurring vehicle logo dataset）上也取得了97.19%的识别率。而在难度较大的XMU（Xiamen University vehicle logo dataset）上，本文方法在100幅训练样本下也达到了96.87%的识别率，识别效果高于一些具有较好表现的车标识别方法，表现出很强的鲁棒性和抗模糊性。

结论

本文方法提高了对成像质量欠缺的车标图像的识别能力，从而提升了整体识别效果，更符合实际应用中车标识别的需求。

Abstract

Objective

Vehicle logo recognition is an important part of anintelligent transportation system (ITS). The vehicle sign carries information about the vehicle

which is important for vehicle information collection

vehicle identification

and illegal vehicle tracking. The vehicle logo

which is designed in various shapes

is a distinctive feature of the vehicle with good independence and representativeness. Through the classification and identification of the vehicle logo

the range of the vehicle model can be greatly reduced

and the pre-classification of the vehicle model can be realized. In practical applications

the traditional handcrafted feature-based methods have fewer training samples

the recognition speed is fast

and the requirements on the equipment are low.Therefore

the traditional handcrafted feature-based methods appear more suitable for actual needs.Although the existing vehicle logo recognition (VLR) method has achieved good recognition results

the final recognition rate is limited and difficult to improve. VLR is a vital part of an intelligent transportation system. Even a small increase in recognition rate can bring great social value. To discover the potential problems and difficulties in VLR

we analyzed samples that have been incorrectly identified.Results show that most of the blurred vehicle logo images are not correctly classified. To extract more representative vehicle image features and effectively reduce the interference caused by blurred images

this paper proposes a vehicle identification method based on anti-blur feature extraction.

Method

Our method first constructed a car image pyramid based on the Gaussian pyramid

which can effectively simulate the human eye. The image anti-texture and anti-edge blur features of the image were extracted to express the information on the logo. The localized LPQ mode is used for anti-texture blurred feature extraction

which can enhance the robustness of the original features. In this process

the feature codebook is generated by clustering the sample features to quantize the feature

and the feature vector of all images is generated based on the codebook. In the process of extracting anti-edge blur features

the HOG feature extraction based on local block weak gradient elimination method is used for anti-edge blurred feature extraction

which can effectively describe the edge feature of vehicle logos and

at the same time

improve their anti-blur ability. Finally

the CCA method is used to fuse the two anti-blur features for subsequent dimensionality reduction and classification.CCA is a multivariate statistical analysis method that uses the correlation between pairs of integrated variables to reflect the overall correlation between the two sets of indicators.

Result

Experiments are conducted based on the blurred vehicle logo dataset (BVL) constructed in this study and two other open vehicle logo datasets. The method achieved a 99.04% recognition rate on the public vehicle dataset HFUT-VLunder 20 training samples. With the increase in the number of samples

the method has a higher upper limit of recognition rate. In addition

the method achieves a recognition rate of 97.19% on the fuzzy car logo dataset BVL constructed under 20 training samples. On the more difficult XMU

the proposed method achieves a recognition rate of 96.87% under 100 training samples. The results show that our method can achieve good recognition results and perform strong robustness and anti-fuzziness.

Conclusion

In this study

the scale invariance of the method is added to the construction of the car image pyramid. At the same time

the improved local quantization mode LPQ feature extraction method improves the anti-texture ability of the feature. By eliminating the local block weak gradient information of the HOG feature

we have improved the anti-edge blurring ability of the feature.Finally

the recognition ability of the vehicle logo images with insufficient imaging quality is improved through the fusion of features

thereby improving the final recognition rate

which is proven suitable for the recognition of vehicle logos in practical applications.

关键词

Keywords

references

An L, Thakoor N and Bhanu B. 2012. Vehicle logo super-resolution by canonical correlation analysis//Proceedings of the 19th IEEE International Conference on Image Processing. Orlando: IEEE: 2229-2232[ DOI: 10.1109/ICIP.2012.6467338 http://dx.doi.org/10.1109/ICIP.2012.6467338 ]

Anakavej T, Kawewong A and Patanukhom K. 2013. Internet-vision based vehicle model query system using eigenfaces and pyramid of histogram of oriented gradients//Proceedings of the 2013 International Conference on Signal-Image Technology and Internet-Based Systems. Kyoto, Japan: IEEE: 179-186[ DOI: 10.1109/SITIS.2013.40 http://dx.doi.org/10.1109/SITIS.2013.40 ]

Dai S J, Huang H, Gao Z Y, Li K and Xiao S M. 2009. Vehicle-logo recognition method based on Tchebichef moment invariants and SVM//Proceedings of the 2009 WRI World Congress on Software Engineering. Xiamen: IEEE: 18-21[ DOI: 10.1109/WCSE.2009.263 http://dx.doi.org/10.1109/WCSE.2009.263 ]

Hu Z, Cho S, Wang J and Yang M H. 2014. Deblurring low-light images with light streaks//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Columbus: IEEE: 3382-3389[ DOI: 10.1109/CVPR.2014.432 http://dx.doi.org/10.1109/CVPR.2014.432 ]

Huang C X, Liang B L, Li W and Han S C. 2017. A convolutional neural network architecture for vehicle logo recognition//Proceedings of the 2017 IEEE International Conference on Unmanned Systems. Beijing: IEEE: 282-287[ DOI: 10.1109/ICUS.2017.8278355 http://dx.doi.org/10.1109/ICUS.2017.8278355 ]

Huang Y, Wu R W, Sun Y, Wang W and Ding X H. 2015. Vehicle logo recognition system based on convolutional neural networks with a pretraining strategy. IEEE Transactions on Intelligent Transportation Systems, 16(4):1951-1960[DOI:10.1109/TITS.2014.2387069]

Hyun Kim T and Mu Lee K. 2014. Segmentation-free dynamic scene deblurring//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Columbus: IEEE: 2766-2773[ DOI: 10.1109/CVPR.2014.348 http://dx.doi.org/10.1109/CVPR.2014.348 ]

Llorca D F, Arroyo R and Sotelo M A. 2013. Vehicle logo recognition in traffic images using HOG features and SVM//Proceedings of the 16th International IEEE Conference on Intelligent Transportation Systems. The Hague, Netherlands: IEEE: 2229-2234[ DOI: 10.1109/ITSC.2013.6728559 http://dx.doi.org/10.1109/ITSC.2013.6728559 ]

Lowe D G. 2004. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2):91-110[DOI:10.1023/B:VISI.0000029664.99615.94]

Ojansivu V and HeikkiläJ. 2008. Blur insensitive texture classification using local phase quantization//Proceedings of the 3rd International Conference on Image and Signal Processing. Cherbourg: Springer: 236-243[ DOI: 10.1007/978-3-540-69905-7_27 http://dx.doi.org/10.1007/978-3-540-69905-7_27 ]

Pan J S, Hu Z, Su Z X and Yang M H. 2017. L 0 -regularized intensity and gradient prior for deblurring text images and beyond. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(2):342-355[DOI:10.1109/TPAMI.2016.2551244].

Peng H Y, Wang X, Wang H Y and Yang W W. 2015. Recognition of low-resolution logos in vehicle images based on statistical random sparse distribution. IEEE Transactions on Intelligent Transportation Systems, 16(2):681-691[DOI:10.1109/TITS.2014.2336675]

Psyllos A, Anagnostopoulos C N and Kayafas E. 2012. M-SIFT: a new method for Vehicle Logo Recognition//Proceedings of the 2012 IEEE International Conference on Vehicular Electronics and Safety. Istanbul: IEEE: 261-266[ DOI: 10.1109/ICVES.2012.6294277 http://dx.doi.org/10.1109/ICVES.2012.6294277 ]

Shi X H, Cai B G and Mu J C. 2002. Development of intelligent transportation system. Journal of Northern Jiaotong University, 26(1):29-34

史新宏, 蔡伯根, 穆建成. 2002.智能交通系统的发展.北京交通大学学报, 26(1):29-34[DOI:10.3969/j.issn.1673-0291.2002.01.007]

Vu N S and Caplier A. 2012. Enhanced patterns of oriented edge magnitudes for face recognition and image matching. IEEE Transactions on Image Processing, 21(3):1352-1365[DOI:10.1109/TIP.2011.2166974]

Xiao J L, Xiang W S and Liu Y C. 2015. Vehicle logo recognition by weighted multi-class support vector machine ensembles based on sharpness histogram features. IET Image Processing, 9(7):527-534[DOI:10.1049/iet-ipr.2014.0691]

Yu Y, Wang J, Lu J T, Xie Y and Nie Z X. 2018. Vehicle logo recognition based on overlapping enhanced patterns of oriented edge magnitudes. Computers and Electrical Engineering, 71:273-283[DOI:10.1016/j.compeleceng.2018.07.045]

Zhu M Y, Cao Z G, Xiao Y and Xie X K. 2015. Blurred face recognition by fusing blur-invariant texture and structure features//Proceedings of the AOPC 2015: Image Processing and Analysis. Beijing: SPIE, 9675: 967515[ DOI: 10.1117/12.2199242 http://dx.doi.org/10.1117/12.2199242 ]

Alert me when the article has been cited

提交

Vehicle logo recognition based on local quantization of enhanced edge gradient features

Comprehensive review of methods for vehicle logo recognition in intelligent transportation systems

Real-time display technology of airborne SAR image in pyramid format

Image Pyramid Structures without Truncation and Data Expansion

Multi-directional integration of gradients