Augmenting Tactile 3D Data Exploration With Pressure Sensing on Mobile Devices

Xiyao Wang, Lonni Besançon, Mehdi Ammi, and Tobias Isenberg.

The aim of this project is to investigate how to combine pressure-sensing with tactile input to better support the visualization tasks for scientific visualization.

Currently we present a pressure-augmented tactile 3D data exploration technique specifically designed for small devices, motivated by the need to support the interactive visualization beyond traditional desktop workstations. While tactile interaction has been studied extensively on large screens, the resulting techniques are not scalable to small and portable devices. Existing 3D interaction mappings require either several touch points/auxiliary widgets or control several degrees of freedom (DOF) simultaneously. On small screens the former causes occlusion, while the latter prohibits precise control. We thus use readily-available pressure sensing with a binary mapping to help users to easily select different navigation techniques. By doing so, we limit screen occlusion and allow users to independently control the DOFs involved in 3D data navigation. We evaluate our approach by comparing it with traditional 3D-RST (rotation, scaling, translation) using a docking task.


Paper for EuroVis 2019

Xiyao Wang, Lonni Besançon, Mehdi Ammi, and Tobias Isenberg (2019) '''[[https://hal.inria.fr/hal-01570442/file/template.pdf| Augmenting Tactile 3D Data Exploration With Pressure Sensing]].''' ' Computer Graphics Forum, Wiley, 2019, 38 (3), pp.635-647. ff10.1111/cgf.13716ff [pdf]

Video Preview IEEE VIS 2017 Poster (30 secondes)

https://youtu.be/nPW-cnMtnaM [Video Preview IEEE VIS 2017 Poster (30 secondes)]

Poster IEEE VIS 2017

Xiyao Wang, Lonni Besançon, Mehdi Ammi, and Tobias Isenberg (2017) '''[[https://hal.archives-ouvertes.fr/hal-02091999/document| Augmenting Tactile 3D Data Navigation With Pressure Sensing]].''' ' IEEE VIS 2017, Oct 2017, Phoenix, Arizona, United States. 2017. [pdf]

Potential Future Work

  • Study the effect of different screen size.
  • Generalize the interaction mapping to old devices with pseudo-pressure.
  • Study how pressure can be used to support other visualization tasks, such as cutting plane manipulation and 3D selection.
  • Study the effect of using multiple pressure levels.