Off-vehicle evaluation of camera-based pedestrian detection

Yaniv Alon, Aharon Bar-Hillel

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations


Performance evaluation and comparison of vision-based automotive modules is a growing need in automotive industry. Off-vehicle evaluation, using a database of video streams offers many advantages over on-vehicle evaluation in terms of reduced costs, repeatability and the ability to compare different modules under the same conditions. An off-vehicle evaluation platform for camera based pedestrian detection is presented, enabling evaluation of industrial modules and internally developed algorithms. In order to maintain a single video database despite variability in camera location and internal parameters, experiments were done with video warping techniques, in which a video is warped to look as if taken from a target camera. To obtain ground truth annotation, both manual and Lidar-based methods were tested. Lidar-based annotation was shown to achieve detection rate > 80% without human intervention, which can go up to 97.5% using a semi-supervised methodology with moderate human effort. Finally, we examined several performance metrics, and found that the image-based detection criteria used in most of the literature does not fit certain automotive application well. A modified criterion based on real world coordinates is suggested.

Original languageEnglish
Title of host publication2012 IEEE Intelligent Vehicles Symposium, IV 2012
Number of pages7
StatePublished - 20 Aug 2012
Externally publishedYes
Event2012 IEEE Intelligent Vehicles Symposium, IV 2012 - Alcal de Henares, Madrid, Spain
Duration: 3 Jun 20127 Jun 2012

Publication series

NameIEEE Intelligent Vehicles Symposium, Proceedings


Conference2012 IEEE Intelligent Vehicles Symposium, IV 2012
CityAlcal de Henares, Madrid

ASJC Scopus subject areas

  • Modeling and Simulation
  • Automotive Engineering
  • Computer Science Applications


Dive into the research topics of 'Off-vehicle evaluation of camera-based pedestrian detection'. Together they form a unique fingerprint.

Cite this