Robust Semi-Supervised Traffic Sign Recognition via Self-Training and Weakly-Supervised Learning.

Obed Tettey Nartey, Guowu Yang, Sarpong Kwadwo Asare, Jinzhao Wu, Lady Nadia Frempong
Author Information
  1. Obed Tettey Nartey: Big Data Research Center, School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China.
  2. Guowu Yang: Big Data Research Center, School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China.
  3. Sarpong Kwadwo Asare: School of Electronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China. ORCID
  4. Jinzhao Wu: Guangxi Key Laboratory of Hybrid Computation and IC Design Analysis, Guangxi University for Nationalities, Nanning 530006, China.
  5. Lady Nadia Frempong: The School of Computer Science and Electronic Information, Guangxi University, Nanning 530004, China.

Abstract

Traffic sign recognition is a classification problem that poses challenges for computer vision and machine learning algorithms. Although both computer vision and machine learning techniques have constantly been improved to solve this problem, the sudden rise in the number of unlabeled traffic signs has become even more challenging. Large data collation and labeling are tedious and expensive tasks that demand much time, expert knowledge, and fiscal resources to satisfy the hunger of deep neural networks. Aside from that, the problem of having unbalanced data also poses a greater challenge to computer vision and machine learning algorithms to achieve better performance. These problems raise the need to develop algorithms that can fully exploit a large amount of unlabeled data, use a small amount of labeled samples, and be robust to data imbalance to build an efficient and high-quality classifier. In this work, we propose a novel semi-supervised classification technique that is robust to small and unbalanced data. The framework integrates weakly-supervised learning and self-training with self-paced learning to generate attention maps to augment the training set and utilizes a novel pseudo-label generation and selection algorithm to generate and select pseudo-labeled samples. The method improves the performance by: (1) normalizing the class-wise confidence levels to prevent the model from ignoring hard-to-learn samples, thereby solving the imbalanced data problem; (2) jointly learning a model and optimizing pseudo-labels generated on unlabeled data; and (3) enlarging the training set to satisfy the hunger of deep learning models. Extensive evaluations on two public traffic sign recognition datasets demonstrate the effectiveness of the proposed technique and provide a potential solution for practical applications.

Keywords

References

  1. IEEE Trans Pattern Anal Mach Intell. 2015 Sep;37(9):1904-16 [PMID: 26353135]
  2. IEEE Trans Cybern. 2017 Apr;47(4):920-933 [PMID: 26992185]
  3. Neural Netw. 2018 Mar;99:158-165 [PMID: 29427842]
  4. IEEE Trans Pattern Anal Mach Intell. 2019 Jul;41(7):1641-1654 [PMID: 29994192]

Word Cloud

Created with Highcharts 10.0.0learningdataproblemsignrecognitioncomputervisionmachinealgorithmsunlabeledtrafficdeepsamplesTrafficclassificationposessatisfyhungerneuralnetworksunbalancedperformanceamountsmallrobustnovelsemi-supervisedtechniqueweakly-supervisedself-trainingself-pacedgeneratetrainingsetmodelchallengesAlthoughtechniquesconstantlyimprovedsolvesuddenrisenumbersignsbecomeevenchallengingLargecollationlabelingtediousexpensivetasksdemandmuchtimeexpertknowledgefiscalresourcesAsidealsogreaterchallengeachievebetterproblemsraiseneeddevelopcanfullyexploitlargeuselabeledimbalancebuildefficienthigh-qualityclassifierworkproposeframeworkintegratesattentionmapsaugmentutilizespseudo-labelgenerationselectionalgorithmselectpseudo-labeledmethodimprovesby:1normalizingclass-wiseconfidencelevelspreventignoringhard-to-learntherebysolvingimbalanced2jointlyoptimizingpseudo-labelsgenerated3enlargingmodelsExtensiveevaluationstwopublicdatasetsdemonstrateeffectivenessproposedprovidepotentialsolutionpracticalapplicationsRobustSemi-SupervisedSignRecognitionviaSelf-TrainingWeakly-SupervisedLearningconvolutional

Similar Articles

Cited By