Dexterous skill transfer between surgical procedures for teleoperated robotic surgery

Mridul Agarwal, Glebys Gonzalez, Mythra V. Balakuntala, Md Masudur Rahman, Vaneet Aggarwal, Richard M. Voyles, Yexiang Xue, Juan Wachs

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

In austere environments, teleoperated surgical robots could save the lives of critically injured patients if they can perform complex surgical maneuvers under limited communication bandwidth. The bandwidth requirement is reduced by transferring atomic surgical actions (referred to as 'surgemes') instead of the low-level kinematic information. While such a policy reduces the bandwidth requirement, it requires accurate recognition of the surgemes. In this paper, we demonstrate that transfer learning across surgical tasks can boost the performance of surgeme recognition. This is demonstrated by using a network pre-trained with peg-transfer data from Yumi robot to learn classification on debridement on data from Taurus robot. Using a pre-trained network improves the classification accuracy achieves a classification accuracy of 76% with only 8 sequences in target domain, which is 22.5% better than no-transfer scenario. Additionally, ablations on transfer learning indicate that transfer learning requires 40% less data compared to no-transfer to achieve same classification accuracy. Further, the convergence rate of the transfer learning setup is significantly higher than the no-transfer setup trained only on the target domain.

Original languageEnglish
Title of host publication2021 30th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2021
PublisherInstitute of Electrical and Electronics Engineers
Pages1236-1242
Number of pages7
ISBN (Electronic)9781665404921
DOIs
StatePublished - 8 Aug 2021
Externally publishedYes
Event30th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2021 - Virtual, Vancouver, Canada
Duration: 8 Aug 202112 Aug 2021

Publication series

Name2021 30th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2021

Conference

Conference30th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2021
Country/TerritoryCanada
CityVirtual, Vancouver
Period8/08/2112/08/21

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Communication
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Dexterous skill transfer between surgical procedures for teleoperated robotic surgery'. Together they form a unique fingerprint.

Cite this