Mobile and Multimodal? A Comparative Evaluation of Interactive Workplaces for Visual Data Exploration
Gabriela Molina León, Michael Lischka, Wei Luo, Andreas Breiter
Computer Graphics Forum, EuroVis conference 2022
This paper was presented at EuroVis 2022 on June 16th, 2022 in the FP 10: Social Sciences, Mobile, and VR/AR session.
Abstract
Mobile devices are increasingly being used in the workplace. The combination of touch, pen, and speech interaction with mobile devices is considered particularly promising for a more natural experience. However, we do not yet know how everyday work with multimodal data visualizations on a mobile device differs from working in the standard WIMP workplace setup. To address this gap, we created a visualization system for social scientists, with a WIMP interface for desktop PCs, and a multimodal interface for tablets. The system provides visualizations to explore spatio-temporal data with consistent WIMP and multimodal interaction techniques. To investigate how the different combinations of devices and interaction modalities affect the performance and experience of domain experts in a work setting, we conducted an experiment with 16 social scientists where they carried out a series of tasks with both interfaces. Participants were significantly faster and slightly more accurate on the WIMP interface. They solved the tasks with different strategies according to the interaction modalities available. The pen was the most used and appreciated input modality. Most participants preferred the multimodal setup and could imagine using it at work. We present our findings, together with their implications for the interaction design of data visualizations.
Materials
Introductory slides for the study: Multimodal interface and WIMP interface
BibTeX
@article{2022-mobilemulti,
title = {Mobile and Multimodal? A Comparative Evaluation of Interactive Workplaces for Visual Data Exploration},
author = {Molina Leon, Gabriela and Lischka, Michael and Luo, Wei and Breiter, Andreas},
year = {2022},
journal = {Computer Graphics Forum},
publisher = {The Eurographics Association and John Wiley & Sons Ltd.},
volume = {41},
ISSN = {1467-8659},
DOI = {10.1111/cgf.14551}
}