Action localization and classification in long-distance surveillance

Eli Chen, Oren Haik, Yitzhak Yitzhaky

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


Suspicious human behaviors can be defined by the user, and in long distance imaging it may include bending the body during walking or crawling, in contrast to regular walking for instance. State-of-the-art methods using convolutional neural networks (CNNs) dealt in general with "clean" signals, in which the object of interest is relatively close to the camera, and therefore fairly clear and easily distinguished from the surrounding environment. This makes it easier to capture detailed information regarding the object and its action. However, in relatively long distance imaging (few kilometers and above) additional difficulties occur which affect the performances of these tasks, since the captured videos are likely to be degraded by the atmospheric path that cause blur and spatiotemporal-varying distortions. Both of these degradation types may reduce the ability for action recognition. These effects become more significant for longer imaging distances and smaller sizes of the objects of interest in the image. The images of objects in imaging through long distance are usually relatively small, and hence, the range of actions that can be resolved is more limited, particularly under strong atmospheric effects. In this study, we perform action localization by first applying optical flow unique processing, and also using a variant of SSD (Single Shot MultiBox Detector) to regress and classify detection boxes in each video frame potentially containing an action of interest.

Original languageEnglish
Title of host publicationCounterterrorism, Crime Fighting, Forensics, and Surveillance Technologies III
EditorsHenri Bouma, Radhakrishna Prabhu, Robert James Stokes, Yitzhak Yitzhaky
ISBN (Electronic)9781510630352
StatePublished - 1 Jan 2019
EventCounterterrorism, Crime Fighting, Forensics, and Surveillance Technologies III 2019 - Strasbourg, France
Duration: 9 Sep 201911 Sep 2019

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X


ConferenceCounterterrorism, Crime Fighting, Forensics, and Surveillance Technologies III 2019

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering


Dive into the research topics of 'Action localization and classification in long-distance surveillance'. Together they form a unique fingerprint.

Cite this