Visiting Patrick Baudisch at HPI

Wow, 6 months at Patrick Baudisch's new Lab at the Hasso-Plattner-Institut in Potsdam, Germany. Patrick is one of the few rock stars in HCI and especially research on touch and multi touch interaction. His brainstorming sessions are legendary (and I can't wait to see the sniff-o-meter in action).

By the time he bought this saw I knew he was serious about building the new Luminos (get the CHI paper here). Did I mention that the saw moved into the women's loo?

It was a brilliant time at Patrick's lab and I think it was the most intense learning experience I've had in a while. My project with him was focussed around sound based overview techniques for object detection and metaphors to improve distance perception with sound. A publication is in preparation!

Project: Simulator sickness

In collaboration with Nokia Research we investigated if spatial sound causes effects of simulator sickness (or motion sickness (there is a lengthy discussion about whether simulator sickness is a form of motion sickness. Therefore we will refer to what made people sick during our experiments as "simulator sickness")).

We started off with a recording made with an improvised binaural recording device (the head) mounted on a manipulated record player that allowed seamless speed manipulation. We compared the binaural recording to a stereo recording (made with a Zoom H4) and found it worth to take a closer look at.

Click "read more" to listen to some sound demos.

Project: Mobile Auditory User Interface

Mobile Auditory User Interfaces are an ongoing research project. The general aim is to design and build an interface that has almost the same capabilities as a visual interface but only relies on (spatial) sound. The prototype we built uses fmod (in the first version) and OpenAL (in the second version) to position sound items on a horizontal plane around the user (who is wearing headphones). As the figure below shows the interface consists of two virtual "rings" around the users head on which auditory representations of items or streams are positioned.

Click "read more" to see some interactive flash demos.