Effect of the User Input Method on Response Time and Accuracy in a Binary Data Labeling Task

This study compares response time and accuracy in a binary data labeling task on two platforms: a desktop computer and a mobile phone. Three methods were used on the computer: a keyboard, a mouse, and a mouse with perceptual variability that was designed to combat vigilance decrement. Three additional methods were used on the mobile phone: a tap, a swipe touch-gesture, and a tap with perceptual variability. Results of the study show that the fastest was the keyboard, which may explain its popularity in labeling tasks. The second fastest was the tap interface, suggesting the unexploited potential of mobile devices for “labeling while waiting for the bus.” In terms of accuracy, we found clear evidence for a speed–accuracy tradeoff, and the advantage of the perceptual variability methods to be more accurate than the matching methods without perceptual variability. The results suggest that different user input methods should be employed depending on whether response time or accuracy is more valued.