Helmet use detection of tracked motorcycles using CNN-based multi-task learning

Hanhe Lin, Jeremiah D. Deng, Deike Albers, Felix Wilhelm Siebert

Research output: Contribution to journalArticlepeer-review

13 Citations (Scopus)
1 Downloads (Pure)

Abstract

Automated detection of motorcycle helmet use through video surveillance can facilitate efficient education and enforcement campaigns that increase road safety. However, existing detection approaches have a number of shortcomings, such as the inabilities to track individual motorcycles through multiple frames, or to distinguish drivers from passengers in helmet use. Furthermore, datasets used to develop approaches are limited in terms of traffic environments and traffic density variations. In this paper, we propose a CNN-based multi-task learning (MTL) method for identifying and tracking individual motorcycles, and register rider specific helmet use. We further release the HELMET dataset, which includes 91,000 annotated frames of 10,006 individual motorcycles from 12 observation sites in Myanmar. Along with the dataset, we introduce an evaluation metric for helmet use and rider detection accuracy, which can be used as a benchmark for evaluating future detection approaches. We show that the use of MTL for concurrent visual similarity learning and helmet use classification improves the efficiency of our approach compared to earlier studies, allowing a processing speed of more than 8 FPS on consumer hardware, and a weighted average F-measure of 67.3% for detecting the number of riders and helmet use of tracked motorcycles. Our work demonstrates the capability of deep learning as a highly accurate and resource efficient approach to collect critical road safety related data.

Original languageEnglish
Article number9184871
Pages (from-to)162073-162084
Number of pages12
JournalIEEE Access
Volume8
Early online date2 Sep 2020
DOIs
Publication statusPublished - 2020

Keywords

  • Deep learning
  • Helmet use detection
  • Motorcycle safety
  • Tracking
  • Traffic surveillance

Fingerprint

Dive into the research topics of 'Helmet use detection of tracked motorcycles using CNN-based multi-task learning'. Together they form a unique fingerprint.

Cite this