Hybrid Tactile/Tangible Interaction for 3D Data Exploration

Lonni Besançon, Paul Issartel, Mehdi Ammi, and Tobias Isenberg.

We present the design and evaluation of an interface that combines tactile and tangible paradigms for 3D visualisation. While studies have demonstrated that both tactile and tangible input can be efficient for a subset of 3D manipulation tasks, we reflect here on the possibility to combine the two complementary input types. Based on a field study and follow-up interviews, we present a conceptual framework of the use of these different interaction modalities for visualisation both separately and combined---focusing on free exploration as well as precise control. We present a prototypical application of a subset of these combined mappings for fluid dynamics data visualisation using a portable, position-aware device which offers both tactile input and tangible sensing. We evaluate our approach with domain experts and report on their qualitative feedback.

Video Demo (3m25s)

https://youtu.be/c4rIEetz4Oo [Video Demo (3m25s)]

Video Preview (30s)

https://vimeo.com/182968639 [Video Preview (30s)]



Poster IEEE VIS 2016

Lonni Besançon, Paul Issartel, Mehdi Ammi, and Tobias Isenberg (2017) Hybrid Tactile/Tangible Interaction for 3D Data Exploration. ' IEEE Transactions on Visualization and Computer Graphics, 23(1):881–890, January 2017.

Poster IEEE VIS 2016

Poster Video Demo IEEE VIS 2016 (2m38s)

https://youtu.be/2bxPQT7p3F8 [Video Demo IEEE VIS 2016 (2m38s)]

Poster Video Preview IEEE VIS 2016 (30s)

https://vimeo.com/182968639 [Video Preview IEEE VIS 2016 (30s)]

Code source

We have implemented the prototype in two parts: the application running on a separate Unix machine for rendering-only options and the app handling all the interaction on the tablet. You can get the code on Github for both the PC program (Unix) and the tablet app (Android, requires Google Tango tablet).

More Information

[Project page @Lonni Besancon]
[Project page @Tobias Isenberg]