TY - GEN
T1 - Creativity and Visual Communication from Machine to Musician
T2 - 13th EAI International Conference on ArtsIT, Interactivity and Game Creation, ArtsIT 2024
AU - Greer, Ross
AU - Fleig, Laura
AU - Dubnov, Shlomo
N1 - Publisher Copyright:
© ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2025.
PY - 2025/1/1
Y1 - 2025/1/1
N2 - This paper explores the integration of visual communication and musical interaction by implementing a robotic camera within a “Guided Harmony” musical game. We aim to examine co-creative behaviors between human musicians and robotic systems. Our research explores existing methodologies like improvisational game pieces and extends these concepts to include robotic participation using a PTZ camera. The robotic system interprets and responds to nonverbal cues from musicians, creating a collaborative and adaptive musical experience. This initial case study underscores the importance of intuitive visual communication channels. We also propose future research directions, including parameters for refining the visual cue toolkit and data collection methods to understand human-machine co-creativity further. Our findings contribute to the broader understanding of machine intelligence in augmenting human creativity, particularly in musical settings.
AB - This paper explores the integration of visual communication and musical interaction by implementing a robotic camera within a “Guided Harmony” musical game. We aim to examine co-creative behaviors between human musicians and robotic systems. Our research explores existing methodologies like improvisational game pieces and extends these concepts to include robotic participation using a PTZ camera. The robotic system interprets and responds to nonverbal cues from musicians, creating a collaborative and adaptive musical experience. This initial case study underscores the importance of intuitive visual communication channels. We also propose future research directions, including parameters for refining the visual cue toolkit and data collection methods to understand human-machine co-creativity further. Our findings contribute to the broader understanding of machine intelligence in augmenting human creativity, particularly in musical settings.
KW - Human-robot interaction
KW - human-machine co-creativity
KW - visual communication
UR - https://www.scopus.com/pages/publications/105011033463
U2 - 10.1007/978-3-031-97254-6_21
DO - 10.1007/978-3-031-97254-6_21
M3 - Conference contribution
AN - SCOPUS:105011033463
SN - 9783031972539
T3 - Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
SP - 296
EP - 309
BT - ArtsIT, Interactivity and Game Creation - 13th EAI International Conference, ArtsIT 2024, Proceedings
A2 - Brooks, Anthony L.
A2 - Banakou, Domna
A2 - Ceperkovic, Slavica
PB - Springer Science and Business Media Deutschland GmbH
Y2 - 13 November 2024 through 15 November 2024
ER -