Our research focuses on innovative ways of seamlessly integrating digital media with the effective, expressive and engaging ways people interact in the physical world. Our goal is to make objects responsive, render surfaces and spaces interactive, and augment the human itself. To do so, we leverage cutting-edge technology, such as printed electronics, interactive paper, flexible and multiple displays. This yields novel interaction possibilities for which we design, implement and study user interfaces and interactive systems.
More about our Research Mission…
Digital Fabrication Technologies
ObjectSkin is a fabrication technique for adding conformal interactive surfaces to everyday objects. It enables multi-touch sensing and display output that seamlessly integrates with highly curved and irregular geometries.
HotFlex leverages printed embedded elements, capable of computer-controlled state change, to enable hands-on remodeling, personalization, and customization of a 3D-printed object after it is printed.
Foldio is a new design and fabrication approach for custom interactive objects. The user defines a 3D model and assigns interactive controls; a fold layout containing printable electronics is auto-generated.
Flexibles add expressive deformation input to interaction with on-screen tangibles. Based on different types of deformation mapping, Flexibles can capture pressing, squeezing, and bending input with multiple levels of intensities.
Capricate, is a fabrication pipeline that enables users to easily design and 3D print highly customized objects that feature embedded capacitive multi-touch sensing.
PrintScreen is an enabling technology for digital fabrication of customized flexible displays using thin-film electroluminescence (TFEL).
A multimodal on-surface and near-surface sensing technique for planar, curved and flexible surfaces.
A Cuttable Multi-touch Sensor
In this project, we propose cutting as a novel paradigm for ad-hoc customization of printed electronic components. We contribute a printed capacitive multi-touch sensor, which can be cut by the end-user to modify its size and shape.
Tacttoo is a feel-through interface for electro-tactile output on the user’s skin. At less than 35μm in thickness, it is the thinnest tactile interface for wearable computing to date.
Multi-Touch Skin are thin and flexible multi-touch sensors for on-skin input. They enable high-resolution multi-touch input on the body and can be customized in size and shape to fit various locations on the body.
FingerInput is a thumb-to-finger gesture recognition system using depth sensing and convolutional neural networks. It is the first system that accurately detects the touch points between fingers as well as the finger flexion.
DeformWear are tiny wearable devices that leverage single-point deformation input on various body locations. This enables expressive and precise input using high-resolution pressure, shear, and pinch deformations.
SkinMarks are thin and conformal skin electronics for on-body interaction. They enable precisely localized input and visual output on strongly curved and elastic body landmarks.
We propose iSkin, a novel class of skin-worn sensors for touch input on the body. iSkin is a very thin sensor overlay, made of biocompatible materials, and is flexible and stretchable.
More Than Touch
An elicitation study on how people interact on skin for controlling mobile devices. Investigates skin-specific input modalities, gestures and their associated mental modals, and preferred input locations.
On-body displays leverage instant availability and human physiology for personal and shared information display.
Flexible and Shape Displays
Flexpad is an interactive system that combines a depth camera and a projector to transform sheets of plain paper or foam into flexible, highly deformable and spatially aware handheld displays.
Future generations of displays will be thin, lighweight, and flexible. In this project, we develop novel interaction techniques for displays which can be dynamically expanded and collapsed.
In this project, we present a novel device concept that features double-sided displays which can be folded using predefined hinges.
Collaborative Use of Rollable Display
Rollable Displays allow for creating tabletop sized displays on-the-go. In this project we investigate the collaborative use in the context of mobile face-to-face encounters.
This works introduces layer jamming as an enabling technology for designing deformable, stiffness-tunable, thin sheet interfaces.
Collaboration on Interactive Surfaces with Personal Input and Output.
This project focuses on designing interaction techniques for hybrid tabletop displays, which enable users to concurrently manipulate digital and physical media on one single surface.
CloudDrops is a pervasive awareness platform that integrates virtual information from the Web more closely with the contextually rich physical spaces in which we live and work.
In this project we investigated how interaction with video can benefit from paper-like displays that support interaction with motion and sound.
In this project, we investigate how the unique affordances of pico projectors can be leveraged for novel, tangible interaction techniques with physical, real world objects.
Mobile Multimedia Interaction
We develop novel interaction techniques for the mobile navigation of multimedia contents.
CoScribe is a collaborative platform for knowledge workers, which tightly integrates paper-based and digital documents. It offers novel interaction techniques for cross-media annotations, hyperlinks and tags on both types of documents.
Letras provides a novel toolkit for the support of pen-based interaction in mobile and ubiquitous computing settings.
PLink: Paper-Based Links for Cross-Media Information Spaces
In this projected, we investigated the use of interactive paper by conducting a multi-week field study.
In this project we investigate pen-based interactions that are based on erasing handwritten contents.