Previsualisation (previs) is an essential phase in the design process of narrative art forms and media such as film, animated series, and stage plays. The goal of first.stage is to research, design, develop, evaluate, and showcase natural user interfaces that improve previsualisation by speaking the language of the artist rather than that of a technician.

This works present an approach for needle-based interventions to provide navigational feedback directly on the instrument and close to the situs by mounting a small display onto the needle.

Marc Herrlich, Parnian Tavakol, David Black, Dirk Wenig, Christian Rieder, Rainer Malaka and Ron Kikinis (2017) Instrument-mounted Displays for Reducing Cognitive Load During Surgical Navigation In Int J CARS: International Journal of Computer Assisted Radiology and Surgery, 1-7. Springer. 10.1007/s11548-017-1540-6 | BibTex

WatchThru expands smartwatches into 3D through a transparent display. This enables novel interactions that leverage and extend smartwatch glanceability.

Dirk Wenig, Johannes Schöning, Alex Olwal, Mathias Oben and Rainer Malaka (2017) WatchThru: Expanding Smartwatch Displays with Mid-air Visuals and Wrist-worn Augmented Reality In CHI '17: Proceedings of the 35th Annual ACM Conference on Human Factors in Computing Systems, 716-721. ACM, New York, NY, USA. 10.1145/3025453.3025852 | PDF of Paper | BibTex