Occlusion-aware Interaction Techniques for Tabletop Systems

TU Darmstadt 2009-2012


Interactive tabletop displays are increasingly wide-spread. They provide very natural ways of interacting with digital media. Information is displayed on a horizontal display and people can use touch input to interact with this information, very much the way we interact with physical objects in the real world.


We explore a hybrid setting in which both types of media are used in combination on the same surface. An example scenario of hybrid use is a desk of the future. On this desk, we concurrently work with books, printed articles, and sticky notes as well as with digital media, such as e-mails or web pages displayed on the desk surface. Moreover, the surface might be covered by non-media physical objects such as a keyboard, cups, pens, etc. While a traditional screen might be better suited for intense reading activity or for writing documents, documents on a tabletop screen favor collaborative practices and structuring by physical arrangements.


In this project, we examine the affordances of this hybrid setting with in-depth user studies. One main challenge of hybrid use is physical occlusion of screen contents. Our first results show in which situations occlusion is problematic. However, we also found that users intentionally create occlusion in order to express semantic information in spatial arrangements. Hybrid piles of printed and digital documents are a frequent arrangement.


Based on these findings, we currently design novel interaction techniques for hybrid tabletops. In particular, we provide support for the efficient selection of occluded items as well as for hybrid grouping and sorting activities. Our fields of application are knowledge work, learning, and interaction in command-and-control-centers.


Publications

ObjecTop: Occlusion Awareness of Physical Objects on Interactive Tabletops

Mohammadreza Khalilbeigi, Jürgen Steimle, Jan Riemann, Niloofar Dezfuli, Max Mühlhäuser, James D. Hollan: ObjecTop: Occlusion Awareness of Physical Objects on Interactive Tabletops, Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces 2013 (ITS 2013).

Physical and Digital Media Usage Patterns on Interactive Tabletop Surfaces

Jürgen Steimle, Mohammadreza Khalilbeigi, Max Mühlhäuser, James D. Hollan: Physical and Digital Media Usage Patterns on Interactive Tabletop Surfaces, Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces 2010 (ITS 2010). [DOI]

Interaction Techniques for Hybrid Piles of Documents on Interactive Tabletops

Mohammadreza Khalilbeigi, Jürgen Steimle, Max Mühlhäuser: Interaction Techniques for Hybrid Piles of Documents on Interactive Tabletops, ACM Conference on Human Factors in Computing Systems (CHI’2010) Extended Abstracts, ACM Press, 2010. [DOI]

Jürgen Steimle, Mohammadreza Khalilbeigi, Max Mühlhäuser: Hybrid Groups of Printed and Digital Documents on Tabletops: A Study, ACM Conference on Human Factors in Computing Systems (CHI’2010) Extended Abstracts, ACM Press, 2010.

Interaction Support for Hybrid Groups of Paper and Digital Documents on Tabletops

Mohammadreza Khalilbeigi, Jürgen Steimle, Max Mühlhäuser: Interaction Support for Hybrid Groups of Paper and Digital Documents on Tabletops, Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (TABLETOP’09) Adjunct CD, ACM Press, 2009.

People

Dr. Jürgen Steimle
Mohammadreza Khalilbeigi
Jan Riemann
Niloofar Dezfuli
Prof. Dr. Max Mühlhäuser
Prof. Jim Hollan