Learning of Dexterous Object Manipulation in a Virtual Reality Environment

Yiming Liu, Clara Gunter, Raz Leib, David W. Franklin

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Humans have unrivalled abilities to perform dexterous object manipulation. This requires the sensorimotor system to quickly adapt to environmental changes and predictively counter act the external disturbances. Many studies have focused on the anticipatory control of digits with real-world experiments. However, examining manipulation using virtual reality with haptic devices expands the possibilities of investigation. In this work, participants grasped and lifted an inverted T-shaped object in a virtual reality setup. The graspable surface of the object was either constrained to a small area or unconstrained. The position of the object's center of mass changed between blocks, and the participants were asked to minimize the rotation of the object during the lift. Our results show that, consistent with the results of real-world experiments, participants gradually learn to adjust the digit positions and forces to predictively compensate for the torque due to the shifted center of mass prior to liftoff. The only major difference found was that the length of trials needed during the adaptation phase to each condition increased from 3 in real-world to 5 in virtual environment.

Original languageEnglish
Title of host publication44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages4175-4178
Number of pages4
ISBN (Electronic)9781728127828
DOIs
StatePublished - 1 Jan 2022
Externally publishedYes
Event44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2022 - Glasgow, United Kingdom
Duration: 11 Jul 202215 Jul 2022

Publication series

NameProceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
Volume2022-July
ISSN (Print)1557-170X

Conference

Conference44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2022
Country/TerritoryUnited Kingdom
CityGlasgow
Period11/07/2215/07/22

ASJC Scopus subject areas

  • Signal Processing
  • Biomedical Engineering
  • Computer Vision and Pattern Recognition
  • Health Informatics

Fingerprint

Dive into the research topics of 'Learning of Dexterous Object Manipulation in a Virtual Reality Environment'. Together they form a unique fingerprint.

Cite this