Talk at the opening of the Fraunhofer IAO interaction lab

The Fraunhofer institute IAO opened today a new interaction lab in Stuttgart under the topic interaction with all senses. Prof. Spath, director of the Fraunhofer IAO, made a strong argument for new user interfaces. In his talk he discussed adaptive cruse control in cars as an example for user interface challenges.

My talk on “implicit interaction – smart living in smart environments” argues for a sensible mix of user centred design and technology driven innovation. As one example I used the Sensor-Knife which Matthias Kranz implemented.

Prof. Jürgen Ziegler, a colleague at the University of Duisburg-Essen who was previously at IAO, showed in his talk a short video of a “galvanic vestibular stimulation” GVS explored by NTT (SIGGRAPH 2005 Demo) to highlight trends and indicate at the same time ethical problems that can arise when we interfere with human senses.

Visit at the University of Hamburg

Yesterday we visited the computer science department at the University of Hamburg. Prof. Oberquelle und Beckhaus had invited me at the Mensch & Computer conference to visit them and give a talk about our work.

Before the seminar we had a chance to see the lab of Steffi Beckhaus. I have tried the ChairIO – and it was fun. They sound floor creates a really interesting experience (similar to the butt-kicker just more intense). We could also play with GranulatSynthese and try the smell user interface (apple smell is absolutely convincing, not sure about some of the others).

We had some discussion on emotions and capturing physiological parameters. Thinking about emotions and senses with regard to a community sharing them opens up a lot of potential for new experiences and potentially applications. We discussed this topic to some extent some weeks ago at the Human Computer Confluence Workshop in Brussels. I really thing a small scale experience in share emotions could move us forward and provide some more insight. In Hamburg they have the NeXus-system (perhaps we should get this too and create a networked application).

In my talk (creating novel user interfaces) I focused on the PhD work of Paul Holleis (KLM for mobile phones, his CHI Paper from last year) and of Heiko Drewes (Eye-Gestures, his Interact’07 paper). The discussion was quite interesting.

World Champion visiting IAIS

Sven Behnke, who won with his humanoid robots the RoboCup, visited us today at Fraunhofer IAIS. In his talk he presented the RoboCup vision – wining in 2050 with humanoid robots against the human world champions and his work towards this goal. There are interesting videos of the robots at http://www.nimbro.net

When I saw Sven presenting the first time (in 2003 at the DFG final round for the “Aktionsplan Informatik”) I was convinced that humanoid robots are far in the future and that the robocup vision is more wishful thinking than vision. Seeing how much it advanced over the last 4 years I am really curious if it will take till 2050.

In his group there is also some interesting work on human-robot interaction. For more see: http://www.informatik.uni-freiburg.de/hr/

Visit to the Wearable Computing Lab at ETH Zurich

I was at ETH Zurich for the PhD defence of Nagendra Bhargava Bharatula. His thesis is on context-aware wearable nodes and in particular on the trade-offs in design and the design space of these devices.

The tour in Prof. Tröster’s lab was very impressive. It is a very active and probably one of the largest groups world wide doing research in wearable computing. It seams that wearable computing is getting more real, many scenarios and demonstrators are much more realistic and useful than several years ago.

In the backmanager project Corinne Mattmann works on a shirt that measures body posture. Using stretch sensors made of elastic threads, which are fixed with silicon to the fabric they can measure several different body postures. The material is really interesting (probably done by http://www.empa.ch/) and I think such technologies will open up many new opportunities. (further reading: Design Concept of Clothing Recognizing Back Postures; C. Mattmann, G. Tröster; Proc. 3rd IEEE-EMBS International Summer School and Symposium on Medical Devices and Biosensors (ISSS-MDBS 2006), Boston, September 4-6, 2006)

The SEAT project (Smart tEchnologies for stress free Air Travel) looks into integration of sensing into a airplane seat set-up. Having seats is a real set-up allows easy testing of ideas and realistic testing in early phases of the project. This setup made me think again more about an automotive setup in my next lab.

Visit at the Institute for Geoinformatics in Münster


Yesterday we had the opportunity to see a set of research demos at the lab of Antonio Krüger at the University of Münster. We had some time to discuss research projects and in the afternoon Nigel and I gave a talk at the Geoinformatics seminar.

We saw exciting work in progress – a nearly ready large scale multi-touch display based on frustrated total internal reflection – according to Antonio the world-largest at the moment. The principle of operation of such a display is very appealing and the demo was convincing. For a comprehensive introduction on the topic see Jef Han’s UIST 2005 technote “Low-cost multi-touch sensing through frustrated total internal reflectionhttp://doi.acm.org/10.1145/1095034.1095054) . I really think we should build one, too (obviously a bit bigger than Antonio’s 😉

Lecture at CDTM in Munich

The CDTM is a joint elite study program from LMU Munich and TU Munich (http://www.cdtm.de/). It offers a set of complementary course for students from different backgrounds including math, business studies, engineering, computer science and media informatics. In their course on multimodal HCI I gave today an introductory lecture on the motivation for and the basics of user interface engineering.

In the seminar room was a real typewrite – in fact a travel type write. It was a real good prop to discuss micro- and macro-efficiency.

One question about the sustainability of a competitive advantage based on user interfaces made me really think. As the user interface is visible it is really hard to protect the competitive advantage and IPR are difficult on this topic. Desktop GUIs are a good example how quickly ideas propagate between competing systems. The only real option to maintain a competitive advantage is to continuously innovate – keeping the status quo means falling behind. The fact that one can not keep new user interface concepts secret (if one includes them in a product) is one of the most exciting aspects of user interfaces research – it is fast moving because everyone shows off their results!

Our Presentations at CHI’07 in San Jose

At this years CHI the Conference on Human Factors in Computing Systems we presented 3 contributions: a full paper, a CHI-note, and a work in progress paper. Have a look at them!

Holleis, P., Otto, F., Hussmann, H., and Schmidt, A. 2007. Keystroke-level model for advanced mobile phone interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA, April 28 – May 03, 2007). CHI ’07. ACM Press, New York, NY, 1505-1514. DOI= http://doi.acm.org/10.1145/1240624.1240851

Atterer, R. and Schmidt, A. 2007. Tracking the interaction of users with AJAX applications for usability testing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA, April 28 – May 03, 2007). CHI ’07. ACM Press, New York, NY, 1347-1350. DOI= http://doi.acm.org/10.1145/1240624.1240828

Holleis, P., Kern, D., and Schmidt, A. 2007. Integrating user performance time models in the design of tangible UIs. In CHI ’07 Extended Abstracts on Human Factors in Computing Systems (San Jose, CA, USA, April 28 – May 03, 2007). CHI ’07. ACM Press, New York, NY, 2423-2428. DOI= http://doi.acm.org/10.1145/1240866.1241018

CeBIT: Context-Awareness for Novel Transport and Logistics Services

At the Fraunhofer Forum at CeBIT I had the chance to talk about future transport solutions. One of my students in Munich (Michael Müller) is working on a pro-active transport container. In the project aware-goods (http://www.comp.lancs.ac.uk/~albrecht/awaregoods/) we looked into this domain already in 2000 at TecO together with SAP Research. Reiterating over the idea is really interesting as now the technology is really here – sensor network nodes are available, mobile phones offer massive processing power, there is ubiquitous data connectivity, and web service interfaces are available for many applications.

The big question is now on algorithms and software for context recognition and data mining in the collected sensor data, the integration with processes and company software systems, and the exploitation for optimising transport and logistics processes.