Drone.io: A Gestural and Visual Interface for Human-Drone Interaction

Jessica R. Cauchard; Alex Tamkin; Cheng Yao Wang; Luke Vink; Michelle Park; Tommy Fang; James A. Landay

doi:10.1109/HRI.2019.8673011

Drone.io: A Gestural and Visual Interface for Human-Drone Interaction

Jessica R. Cauchard, Alex Tamkin, Cheng Yao Wang, Luke Vink, Michelle Park, Tommy Fang, James A. Landay

Department of Industrial Engineering and Management

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

48 Scopus citations

Abstract

Drones are becoming ubiquitous and offer support to people in various tasks, such as photography, in increasingly interactive social contexts. We introduce drone.io, a projected body-centric graphical user interface for human-drone interaction. Using two simple gestures, users can interact with a drone in a natural manner. drone.io is the first human-drone graphical user interface embedded on a drone to provide both input and output capabilities. This paper describes the design process of drone.io. We present a proof of concept, drone-based implementation, as well as a fully functional prototype for a drone tour-guide scenario. We report drone.io's evaluation in three user studies (N=27) and show that people were able to use the interface with little prior training. We contribute to the field of human-robot interaction and the growing field of human-drone interaction.

Original language	English
Title of host publication	HRI 2019 - 14th ACM/IEEE International Conference on Human-Robot Interaction
Publisher	Institute of Electrical and Electronics Engineers
Pages	153-162
Number of pages	10
Volume	2019- March
ISBN (Electronic)	9781538685556
DOIs	https://doi.org/10.1109/HRI.2019.8673011
State	Published - 22 Mar 2019
Event	14th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2019 - Daegu, Korea, Republic of Duration: 11 Mar 2019 → 14 Mar 2019

Conference

Conference	14th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2019
Country/Territory	Korea, Republic of
City	Daegu
Period	11/03/19 → 14/03/19

Keywords

Human-Drone Interaction
Mid-Air Gestures
Mobile Projector
Radial Menus
Robotics
UAV

ASJC Scopus subject areas

Artificial Intelligence
Human-Computer Interaction
Electrical and Electronic Engineering

Access to Document

10.1109/HRI.2019.8673011

Cite this

Cauchard, J. R., Tamkin, A., Wang, C. Y., Vink, L., Park, M., Fang, T., & Landay, J. A. (2019). Drone.io: A Gestural and Visual Interface for Human-Drone Interaction. In HRI 2019 - 14th ACM/IEEE International Conference on Human-Robot Interaction (Vol. 2019- March, pp. 153-162). Article 8673011 Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/HRI.2019.8673011

@inproceedings{f01d25dc40dd422fa749a3691d3f3b8b,

title = "Drone.io: A Gestural and Visual Interface for Human-Drone Interaction",

abstract = "Drones are becoming ubiquitous and offer support to people in various tasks, such as photography, in increasingly interactive social contexts. We introduce drone.io, a projected body-centric graphical user interface for human-drone interaction. Using two simple gestures, users can interact with a drone in a natural manner. drone.io is the first human-drone graphical user interface embedded on a drone to provide both input and output capabilities. This paper describes the design process of drone.io. We present a proof of concept, drone-based implementation, as well as a fully functional prototype for a drone tour-guide scenario. We report drone.io's evaluation in three user studies (N=27) and show that people were able to use the interface with little prior training. We contribute to the field of human-robot interaction and the growing field of human-drone interaction.",

keywords = "Human-Drone Interaction, Mid-Air Gestures, Mobile Projector, Radial Menus, Robotics, UAV",

author = "Cauchard, {Jessica R.} and Alex Tamkin and Wang, {Cheng Yao} and Luke Vink and Michelle Park and Tommy Fang and Landay, {James A.}",

note = "ACM/IEEE International Conference on Human-Robot Interaction ISSN (Electronic): 2167-2148; 14th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2019 ; Conference date: 11-03-2019 Through 14-03-2019",

year = "2019",

month = mar,

day = "22",

doi = "10.1109/HRI.2019.8673011",

language = "English",

volume = "2019- March",

pages = "153--162",

booktitle = "HRI 2019 - 14th ACM/IEEE International Conference on Human-Robot Interaction",

publisher = "Institute of Electrical and Electronics Engineers",

address = "United States",

}

Cauchard, JR, Tamkin, A, Wang, CY, Vink, L, Park, M, Fang, T & Landay, JA 2019, Drone.io: A Gestural and Visual Interface for Human-Drone Interaction. in HRI 2019 - 14th ACM/IEEE International Conference on Human-Robot Interaction. vol. 2019- March, 8673011, Institute of Electrical and Electronics Engineers, pp. 153-162, 14th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2019, Daegu, Korea, Republic of, 11/03/19. https://doi.org/10.1109/HRI.2019.8673011

Drone.io: A Gestural and Visual Interface for Human-Drone Interaction. / Cauchard, Jessica R.; Tamkin, Alex; Wang, Cheng Yao et al.
HRI 2019 - 14th ACM/IEEE International Conference on Human-Robot Interaction. Vol. 2019- March Institute of Electrical and Electronics Engineers, 2019. p. 153-162 8673011.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Drone.io

T2 - 14th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2019

AU - Cauchard, Jessica R.

AU - Tamkin, Alex

AU - Wang, Cheng Yao

AU - Vink, Luke

AU - Park, Michelle

AU - Fang, Tommy

AU - Landay, James A.

N1 - ACM/IEEE International Conference on Human-Robot Interaction ISSN (Electronic): 2167-2148

PY - 2019/3/22

Y1 - 2019/3/22

N2 - Drones are becoming ubiquitous and offer support to people in various tasks, such as photography, in increasingly interactive social contexts. We introduce drone.io, a projected body-centric graphical user interface for human-drone interaction. Using two simple gestures, users can interact with a drone in a natural manner. drone.io is the first human-drone graphical user interface embedded on a drone to provide both input and output capabilities. This paper describes the design process of drone.io. We present a proof of concept, drone-based implementation, as well as a fully functional prototype for a drone tour-guide scenario. We report drone.io's evaluation in three user studies (N=27) and show that people were able to use the interface with little prior training. We contribute to the field of human-robot interaction and the growing field of human-drone interaction.

AB - Drones are becoming ubiquitous and offer support to people in various tasks, such as photography, in increasingly interactive social contexts. We introduce drone.io, a projected body-centric graphical user interface for human-drone interaction. Using two simple gestures, users can interact with a drone in a natural manner. drone.io is the first human-drone graphical user interface embedded on a drone to provide both input and output capabilities. This paper describes the design process of drone.io. We present a proof of concept, drone-based implementation, as well as a fully functional prototype for a drone tour-guide scenario. We report drone.io's evaluation in three user studies (N=27) and show that people were able to use the interface with little prior training. We contribute to the field of human-robot interaction and the growing field of human-drone interaction.

KW - Human-Drone Interaction

KW - Mid-Air Gestures

KW - Mobile Projector

KW - Radial Menus

KW - Robotics

KW - UAV

UR - http://www.scopus.com/inward/record.url?scp=85063985659&partnerID=8YFLogxK

U2 - 10.1109/HRI.2019.8673011

DO - 10.1109/HRI.2019.8673011

M3 - Conference contribution

AN - SCOPUS:85063985659

VL - 2019- March

SP - 153

EP - 162

BT - HRI 2019 - 14th ACM/IEEE International Conference on Human-Robot Interaction

PB - Institute of Electrical and Electronics Engineers

Y2 - 11 March 2019 through 14 March 2019

ER -

Drone.io: A Gestural and Visual Interface for Human-Drone Interaction

Abstract

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this