Avoiding focus shifts in surgical telementoring using an augmented reality transparent display

Daniel Andersen; Voicu Popescu; Maria Eugenia Cabrera; Aditya Shanghavi; Gerardo Gomez; Sherri Marley; Brian Mullis; Juan Wachs

doi:10.3233/978-1-61499-625-5-9

Avoiding focus shifts in surgical telementoring using an augmented reality transparent display

Daniel Andersen, Voicu Popescu, Maria Eugenia Cabrera, Aditya Shanghavi, Gerardo Gomez, Sherri Marley, Brian Mullis, Juan Wachs

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

10 Scopus citations

Abstract

Conventional surgical telementoring systems require the trainee to shift focus away from the operating field to a nearby monitor to receive mentor guidance. This paper presents the next generation of telementoring systems. Our system, STAR (System for Telementoring with Augmented Reality) avoids focus shifts by placing mentor annotations directly into the trainee's field of view using augmented reality transparent display technology. This prototype was tested with pre-medical and medical students. Experiments were conducted where participants were asked to identify precise operating field locations communicated to them using either STAR or a conventional telementoring system. STAR was shown to improve accuracy and to reduce focus shifts. The initial STAR prototype only provides an approximate transparent display effect, without visual continuity between the display and the surrounding area. The current version of our transparent display provides visual continuity by showing the geometry and color of the operating field from the trainee's viewpoint.

Original language	English
Title of host publication	Medicine Meets Virtual Reality 22, NextMed/MMVR 22
Editors	Li Fellander-Tsai, Kirby G. Vosburgh, James D. Westwood, Steven Senger, Susan W. Westwood, Cali M. Fidopiastis, Alan Liu
Publisher	IOS Press
Pages	9-14
Number of pages	6
ISBN (Electronic)	9781614996248
DOIs	https://doi.org/10.3233/978-1-61499-625-5-9
State	Published - 1 Jan 2016
Externally published	Yes
Event	Medicine Meets Virtual Reality 22, NextMed/MMVR 2016 - Los Angeles, United States Duration: 7 Apr 2016 → 9 Apr 2016

Publication series

Name	Studies in Health Technology and Informatics
Volume	220
ISSN (Print)	0926-9630
ISSN (Electronic)	1879-8365

Conference

Conference	Medicine Meets Virtual Reality 22, NextMed/MMVR 2016
Country/Territory	United States
City	Los Angeles
Period	7/04/16 → 9/04/16

Keywords

Augmented reality
Telemedicine
Telementoring
Transparent displays

ASJC Scopus subject areas

Biomedical Engineering
Health Informatics
Health Information Management

Access to Document

10.3233/978-1-61499-625-5-9

Cite this

Andersen, D., Popescu, V., Cabrera, M. E., Shanghavi, A., Gomez, G., Marley, S., Mullis, B., & Wachs, J. (2016). Avoiding focus shifts in surgical telementoring using an augmented reality transparent display. In L. Fellander-Tsai, K. G. Vosburgh, J. D. Westwood, S. Senger, S. W. Westwood, C. M. Fidopiastis, & A. Liu (Eds.), Medicine Meets Virtual Reality 22, NextMed/MMVR 22 (pp. 9-14). (Studies in Health Technology and Informatics; Vol. 220). IOS Press. https://doi.org/10.3233/978-1-61499-625-5-9

Andersen, Daniel ; Popescu, Voicu ; Cabrera, Maria Eugenia et al. / Avoiding focus shifts in surgical telementoring using an augmented reality transparent display. Medicine Meets Virtual Reality 22, NextMed/MMVR 22. editor / Li Fellander-Tsai ; Kirby G. Vosburgh ; James D. Westwood ; Steven Senger ; Susan W. Westwood ; Cali M. Fidopiastis ; Alan Liu. IOS Press, 2016. pp. 9-14 (Studies in Health Technology and Informatics).

@inproceedings{c37eea0fb8d144bc921cdceaa8b2476f,

title = "Avoiding focus shifts in surgical telementoring using an augmented reality transparent display",

abstract = "Conventional surgical telementoring systems require the trainee to shift focus away from the operating field to a nearby monitor to receive mentor guidance. This paper presents the next generation of telementoring systems. Our system, STAR (System for Telementoring with Augmented Reality) avoids focus shifts by placing mentor annotations directly into the trainee's field of view using augmented reality transparent display technology. This prototype was tested with pre-medical and medical students. Experiments were conducted where participants were asked to identify precise operating field locations communicated to them using either STAR or a conventional telementoring system. STAR was shown to improve accuracy and to reduce focus shifts. The initial STAR prototype only provides an approximate transparent display effect, without visual continuity between the display and the surrounding area. The current version of our transparent display provides visual continuity by showing the geometry and color of the operating field from the trainee's viewpoint.",

keywords = "Augmented reality, Telemedicine, Telementoring, Transparent displays",

author = "Daniel Andersen and Voicu Popescu and Cabrera, {Maria Eugenia} and Aditya Shanghavi and Gerardo Gomez and Sherri Marley and Brian Mullis and Juan Wachs",

note = "Publisher Copyright: {\textcopyright} 2016 The authors and IOS Press. All rights reserved.; Medicine Meets Virtual Reality 22, NextMed/MMVR 2016 ; Conference date: 07-04-2016 Through 09-04-2016",

year = "2016",

month = jan,

day = "1",

doi = "10.3233/978-1-61499-625-5-9",

language = "English",

series = "Studies in Health Technology and Informatics",

publisher = "IOS Press",

pages = "9--14",

editor = "Li Fellander-Tsai and Vosburgh, {Kirby G.} and Westwood, {James D.} and Steven Senger and Westwood, {Susan W.} and Fidopiastis, {Cali M.} and Alan Liu",

booktitle = "Medicine Meets Virtual Reality 22, NextMed/MMVR 22",

address = "Netherlands",

}

Andersen, D, Popescu, V, Cabrera, ME, Shanghavi, A, Gomez, G, Marley, S, Mullis, B & Wachs, J 2016, Avoiding focus shifts in surgical telementoring using an augmented reality transparent display. in L Fellander-Tsai, KG Vosburgh, JD Westwood, S Senger, SW Westwood, CM Fidopiastis & A Liu (eds), Medicine Meets Virtual Reality 22, NextMed/MMVR 22. Studies in Health Technology and Informatics, vol. 220, IOS Press, pp. 9-14, Medicine Meets Virtual Reality 22, NextMed/MMVR 2016, Los Angeles, United States, 7/04/16. https://doi.org/10.3233/978-1-61499-625-5-9

Avoiding focus shifts in surgical telementoring using an augmented reality transparent display. / Andersen, Daniel; Popescu, Voicu; Cabrera, Maria Eugenia et al.
Medicine Meets Virtual Reality 22, NextMed/MMVR 22. ed. / Li Fellander-Tsai; Kirby G. Vosburgh; James D. Westwood; Steven Senger; Susan W. Westwood; Cali M. Fidopiastis; Alan Liu. IOS Press, 2016. p. 9-14 (Studies in Health Technology and Informatics; Vol. 220).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Avoiding focus shifts in surgical telementoring using an augmented reality transparent display

AU - Andersen, Daniel

AU - Popescu, Voicu

AU - Cabrera, Maria Eugenia

AU - Shanghavi, Aditya

AU - Gomez, Gerardo

AU - Marley, Sherri

AU - Mullis, Brian

AU - Wachs, Juan

PY - 2016/1/1

Y1 - 2016/1/1

N2 - Conventional surgical telementoring systems require the trainee to shift focus away from the operating field to a nearby monitor to receive mentor guidance. This paper presents the next generation of telementoring systems. Our system, STAR (System for Telementoring with Augmented Reality) avoids focus shifts by placing mentor annotations directly into the trainee's field of view using augmented reality transparent display technology. This prototype was tested with pre-medical and medical students. Experiments were conducted where participants were asked to identify precise operating field locations communicated to them using either STAR or a conventional telementoring system. STAR was shown to improve accuracy and to reduce focus shifts. The initial STAR prototype only provides an approximate transparent display effect, without visual continuity between the display and the surrounding area. The current version of our transparent display provides visual continuity by showing the geometry and color of the operating field from the trainee's viewpoint.

AB - Conventional surgical telementoring systems require the trainee to shift focus away from the operating field to a nearby monitor to receive mentor guidance. This paper presents the next generation of telementoring systems. Our system, STAR (System for Telementoring with Augmented Reality) avoids focus shifts by placing mentor annotations directly into the trainee's field of view using augmented reality transparent display technology. This prototype was tested with pre-medical and medical students. Experiments were conducted where participants were asked to identify precise operating field locations communicated to them using either STAR or a conventional telementoring system. STAR was shown to improve accuracy and to reduce focus shifts. The initial STAR prototype only provides an approximate transparent display effect, without visual continuity between the display and the surrounding area. The current version of our transparent display provides visual continuity by showing the geometry and color of the operating field from the trainee's viewpoint.

KW - Augmented reality

KW - Telemedicine

KW - Telementoring

KW - Transparent displays

UR - http://www.scopus.com/inward/record.url?scp=84965025901&partnerID=8YFLogxK

U2 - 10.3233/978-1-61499-625-5-9

DO - 10.3233/978-1-61499-625-5-9

M3 - Conference contribution

C2 - 27046545

AN - SCOPUS:84965025901

T3 - Studies in Health Technology and Informatics

SP - 9

EP - 14

BT - Medicine Meets Virtual Reality 22, NextMed/MMVR 22

A2 - Fellander-Tsai, Li

A2 - Vosburgh, Kirby G.

A2 - Westwood, James D.

A2 - Senger, Steven

A2 - Westwood, Susan W.

A2 - Fidopiastis, Cali M.

A2 - Liu, Alan

PB - IOS Press

T2 - Medicine Meets Virtual Reality 22, NextMed/MMVR 2016

Y2 - 7 April 2016 through 9 April 2016

ER -

Andersen D, Popescu V, Cabrera ME, Shanghavi A, Gomez G, Marley S et al. Avoiding focus shifts in surgical telementoring using an augmented reality transparent display. In Fellander-Tsai L, Vosburgh KG, Westwood JD, Senger S, Westwood SW, Fidopiastis CM, Liu A, editors, Medicine Meets Virtual Reality 22, NextMed/MMVR 22. IOS Press. 2016. p. 9-14. (Studies in Health Technology and Informatics). doi: 10.3233/978-1-61499-625-5-9

Avoiding focus shifts in surgical telementoring using an augmented reality transparent display

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this