Visual reinforcement learning for object recognition in robotics

Dan Malowany, Hugo Guterman

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In recent years, unmanned systems reached a maturity level that resulted in the adoption of robotic system for both civil and military usages. As the amount of unmanned systems increases, the amount of visual information that is being sent to the end user increases, and the need to develop the unmanned systems ability to autonomously alert the user on predefined events is being emphasized. This ability is mainly based on their capability to detect and classify the objects in their field of operation. Recent studies shows that the mechanism behind the recognition process in the human brain includes continuous generation of predictions based on prior knowledge about the world. These predictions enable rapid generation of hypothesis that biases the outcome of the recognition process in situation of uncertainty. In addition, the visual system continuously updating its knowledge about the world based on visual feedback. In our work, we formed an architecture that is based on the concepts behind these top-down prediction and learning processes of the human visual system, together with state of the art bottom-up object recognition models, e.g. deep CNNs. We show that imitating these top-down reinforcement learning mechanisms, together with the state of the art bottom-up feed-forward algorithm, creates an accurate and continuously improving target recognition model.

Original languageEnglish
Title of host publication2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781509021529
DOIs
StatePublished - 4 Jan 2017
Event2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016 - Eilat, Israel
Duration: 16 Nov 201618 Nov 2016

Publication series

Name2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016

Conference

Conference2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016
Country/TerritoryIsrael
CityEilat
Period16/11/1618/11/16

ASJC Scopus subject areas

  • Computer Science Applications
  • Hardware and Architecture
  • Artificial Intelligence
  • Computer Networks and Communications
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Visual reinforcement learning for object recognition in robotics'. Together they form a unique fingerprint.

Cite this