TY - GEN
T1 - Dexterous skill transfer between surgical procedures for teleoperated robotic surgery
AU - Agarwal, Mridul
AU - Gonzalez, Glebys
AU - Balakuntala, Mythra V.
AU - Masudur Rahman, Md
AU - Aggarwal, Vaneet
AU - Voyles, Richard M.
AU - Xue, Yexiang
AU - Wachs, Juan
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021/8/8
Y1 - 2021/8/8
N2 - In austere environments, teleoperated surgical robots could save the lives of critically injured patients if they can perform complex surgical maneuvers under limited communication bandwidth. The bandwidth requirement is reduced by transferring atomic surgical actions (referred to as 'surgemes') instead of the low-level kinematic information. While such a policy reduces the bandwidth requirement, it requires accurate recognition of the surgemes. In this paper, we demonstrate that transfer learning across surgical tasks can boost the performance of surgeme recognition. This is demonstrated by using a network pre-trained with peg-transfer data from Yumi robot to learn classification on debridement on data from Taurus robot. Using a pre-trained network improves the classification accuracy achieves a classification accuracy of 76% with only 8 sequences in target domain, which is 22.5% better than no-transfer scenario. Additionally, ablations on transfer learning indicate that transfer learning requires 40% less data compared to no-transfer to achieve same classification accuracy. Further, the convergence rate of the transfer learning setup is significantly higher than the no-transfer setup trained only on the target domain.
AB - In austere environments, teleoperated surgical robots could save the lives of critically injured patients if they can perform complex surgical maneuvers under limited communication bandwidth. The bandwidth requirement is reduced by transferring atomic surgical actions (referred to as 'surgemes') instead of the low-level kinematic information. While such a policy reduces the bandwidth requirement, it requires accurate recognition of the surgemes. In this paper, we demonstrate that transfer learning across surgical tasks can boost the performance of surgeme recognition. This is demonstrated by using a network pre-trained with peg-transfer data from Yumi robot to learn classification on debridement on data from Taurus robot. Using a pre-trained network improves the classification accuracy achieves a classification accuracy of 76% with only 8 sequences in target domain, which is 22.5% better than no-transfer scenario. Additionally, ablations on transfer learning indicate that transfer learning requires 40% less data compared to no-transfer to achieve same classification accuracy. Further, the convergence rate of the transfer learning setup is significantly higher than the no-transfer setup trained only on the target domain.
UR - http://www.scopus.com/inward/record.url?scp=85115080965&partnerID=8YFLogxK
U2 - 10.1109/RO-MAN50785.2021.9515453
DO - 10.1109/RO-MAN50785.2021.9515453
M3 - Conference contribution
AN - SCOPUS:85115080965
T3 - 2021 30th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2021
SP - 1236
EP - 1242
BT - 2021 30th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2021
PB - Institute of Electrical and Electronics Engineers
T2 - 30th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2021
Y2 - 8 August 2021 through 12 August 2021
ER -