Telemoji: A video chat with automated recognition of facial expressions

Alex Kreinis, Tom Damri, Tomer Leon, Marina Litvak, Irina Rabaev

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Autism spectrum disorder (ASD) is frequently ac-companied by impairment in emotional expression recognition, and therefore individuals with ASD may find it hard to interpret emotions and interact. Inspired by this fact, we developed a web-based video chat to assist people with ASD, both for real-time recognition of facial emotions and for practicing. This real-time application detects the speaker's face in a video stream and classifies the expressed emotion into one of the seven categories: neutral, surprise, happy, angry, disgust, fear, and sad. The classification is then displayed as the text label below the speaker's face. We developed this application as a part of the undergraduate project for the B.Sc. degree in Software Engineering. Its development and testing were made with the cooperation of the local society for children and adults with autism. The application has been released for unrestricted use on https://telemojii.herokuapp.com/. The demo is available at http://www.filedropper.com/telemojishortdemoblur.

Original languageEnglish
Title of host publication2021 International Conference on Visual Communications and Image Processing, VCIP 2021 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers
ISBN (Electronic)9781728185514
DOIs
StatePublished - 1 Jan 2021
Externally publishedYes
Event2021 International Conference on Visual Communications and Image Processing, VCIP 2021 - Munich, Germany
Duration: 5 Dec 20218 Dec 2021

Publication series

Name2021 International Conference on Visual Communications and Image Processing, VCIP 2021 - Proceedings

Conference

Conference2021 International Conference on Visual Communications and Image Processing, VCIP 2021
Country/TerritoryGermany
CityMunich
Period5/12/218/12/21

Keywords

  • Autism Spectrum Disorder
  • Deep Learning Network
  • Emotion Recognition
  • Facial Expressions Recognition

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Signal Processing
  • Sensory Systems
  • Communication

Fingerprint

Dive into the research topics of 'Telemoji: A video chat with automated recognition of facial expressions'. Together they form a unique fingerprint.

Cite this