Skip to main navigation Skip to search Skip to main content

Robot-Led Vision Language Model Wellbeing Assessment of Children

  • Nida Itrat Abbasi
  • , Fethiye Irmak Dogan
  • , Guy Laban
  • , Joanna Anderson
  • , Tamsin Ford
  • , Peter B. Jones
  • , Hatice Gunes

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This study presents a novel robot-led approach to assessing children's mental wellbeing using a Vision Language Model (VLM). Inspired by the Child Apperception Test (CAT), the social robot NAO presented children with pictorial stimuli to elicit their verbal narratives of the images, which were then evaluated by a VLM in accordance with CAT assessment guidelines. The VLM's assessments were systematically compared to those provided by a trained psychologist. The results reveal that while the VLM demonstrates moderate reliability in identifying cases with no wellbeing concerns, its ability to accurately classify assessments with wellbeing concerns remains limited. Moreover, although the model's performance was generally consistent when prompted with varying demographic factors such as age and gender, a significantly higher false positive rate was observed for girls, indicating potential sensitivity to gender attribute. These findings highlight both the promise and the challenges of integrating VLMs into robot-led assessments of children's wellbeing.

Original languageEnglish
Title of host publication2025 34th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2025
PublisherInstitute of Electrical and Electronics Engineers
Pages59-64
Number of pages6
ISBN (Electronic)9798331587710
DOIs
StatePublished - 1 Jan 2025
Externally publishedYes
Event34th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2025 - Hybrid, Eindhoven, Netherlands
Duration: 25 Aug 202529 Aug 2025

Publication series

NameIEEE International Workshop on Robot and Human Communication, RO-MAN
ISSN (Print)1944-9445
ISSN (Electronic)1944-9437

Conference

Conference34th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2025
Country/TerritoryNetherlands
CityHybrid, Eindhoven
Period25/08/2529/08/25

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Robot-Led Vision Language Model Wellbeing Assessment of Children'. Together they form a unique fingerprint.

Cite this