Seminar: Intelligent Multimodal Interaction in Augmented Reality

Description

Augmented Reality (AR) systems are rapidly expanding beyond visual overlays, with off-the-shelf AR devices increasingly supporting a broader set of interaction modalities including audio, gaze, and gesture. Recent advances in AI have also created new opportunities to make multimodal AR experiences more context-aware and adaptive. This seminar will explore the potential for leveraging multimodality to design AR systems and experiences that are more effective and intuitive than their unimodal counterparts. Through a combination of paper readings, discussions, and a design task, students will learn to critically read, situate, and build on the state of the art in intelligent multimodal AR.

Activities

The seminar comprises a combination of readings, presentations, and the conceptual design of a novel multimodal AR system. Each student will read and present one research paper focused on a core theme of multimodal AR in Human-Computer Interaction. Students will also read the other papers and contribute to discussions in the seminar sessions. Finally, they will design a novel interactive AR system using techniques and methods learnt in the course (no programming/coding will be required).

Registration

Please note that the number of participants is limited to 10.

Participation in person is mandatory for all seminar session!
This is a master-level seminar, which can also be taken by Bachelor students from 5th study semester and above.

For the registration, we require you to submit a brief motivation statement that elaborates on why you want to take this class and what relevant projects and courses you have taken before.

Participants must have completed at least one of the following courses (or an equivalent course at another university): the core lecture “Human-Computer Interaction” or the lecture “Interactive Systems”.

People

Prof. Dr. Jürgen Steimle
Radha Kumaran
Ashwin Ram

Contact

kumaran@cs.uni-saarland.de