Lecture at CDTM in Munich

The CDTM is a joint elite study program from LMU Munich and TU Munich (http://www.cdtm.de/). It offers a set of complementary course for students from different backgrounds including math, business studies, engineering, computer science and media informatics. In their course on multimodal HCI I gave today an introductory lecture on the motivation for and the basics of user interface engineering.

In the seminar room was a real typewrite – in fact a travel type write. It was a real good prop to discuss micro- and macro-efficiency.

One question about the sustainability of a competitive advantage based on user interfaces made me really think. As the user interface is visible it is really hard to protect the competitive advantage and IPR are difficult on this topic. Desktop GUIs are a good example how quickly ideas propagate between competing systems. The only real option to maintain a competitive advantage is to continuously innovate – keeping the status quo means falling behind. The fact that one can not keep new user interface concepts secret (if one includes them in a product) is one of the most exciting aspects of user interfaces research – it is fast moving because everyone shows off their results!

Our Presentations at CHI’07 in San Jose

At this years CHI the Conference on Human Factors in Computing Systems we presented 3 contributions: a full paper, a CHI-note, and a work in progress paper. Have a look at them!

Holleis, P., Otto, F., Hussmann, H., and Schmidt, A. 2007. Keystroke-level model for advanced mobile phone interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA, April 28 – May 03, 2007). CHI ’07. ACM Press, New York, NY, 1505-1514. DOI= http://doi.acm.org/10.1145/1240624.1240851

Atterer, R. and Schmidt, A. 2007. Tracking the interaction of users with AJAX applications for usability testing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA, April 28 – May 03, 2007). CHI ’07. ACM Press, New York, NY, 1347-1350. DOI= http://doi.acm.org/10.1145/1240624.1240828

Holleis, P., Kern, D., and Schmidt, A. 2007. Integrating user performance time models in the design of tangible UIs. In CHI ’07 Extended Abstracts on Human Factors in Computing Systems (San Jose, CA, USA, April 28 – May 03, 2007). CHI ’07. ACM Press, New York, NY, 2423-2428. DOI= http://doi.acm.org/10.1145/1240866.1241018

Visit at the Academy of Media Arts Cologne

Today I was invited at the Citizen Media seminar to discuss mobile and ubiquitous computing topics with people working in the project. Fraunhofer IAIS and the Academy of Media Arts Cologne are both partners in the European Citizen Media project (http://www.ist-citizenmedia.org/). It is a difficult question how to create and support a mobile community. The provision of software and infrastructure is obviously required – e.g. Alexander De Luca and Michael Müller (students I supervised in Munich) designed and implemented an open source software as a basis for mobile blogging (mobile reporter) – but the process that forms and evolves specific community is still little understood.

It was great to meet Georg Trogemann, who is professor for audiovisuell art and computer science at the Academy of Media Arts Cologne. Only after I had left I realised that he is the author of a quite interesting book a recently got (Code@Art; ISBN 3-211-20438-5).

We had an interesting discussion on how to most effectively involve users in the design process of novel products. In particular when we expect that technology drives innovation and when future user needs are to be anticipated. I reported from our very positive experience with technology probes (article at IEEE Percom). To me it is central to involve users from the very beginning and throughout all stages of a project and at the same time allow technology to drive innovation beyond current users’ needs.

We had much too little time to see all the interesting projects that are going on there so we have to go back there 😉 the lab and setup in Cologne reminded me of Bill Gaver’s group at RCA (when we worked together in Equator some year ago).

What happens if you ask the customer (user)?

Dell started some time ago a web page where the public was asked for comments on improvement (http://www.ideastorm.com) – by now the list is quite impressive – at least in length. Such open community processes are really exciting to watch. I am curious which of those suggestions are implemented and how successful it is to listen to customers direct responses. If it works well others are probably trying it, too…

To make the most out of these suggestions and comments it seems essential to perform a detailed analysis (perhaps taking into account temporal dynamics of the conversation additionally to the content) – looks like another really interesting field for text-mining.

Don’t wash your dishes before loging on to the computer

This morning I washed my dished (manually in a kitchen sink) and afterwards (with dry hands) I tried to log on to my computer using the finger print scanner. My thumb did not work anymore. Looking closer at my thumb it seemed clear that this looked temporarily different as it was in the water for 10 minutes. A few minutes later the thumb is back to normal, but I already logged using a password. What do I learn from this – If I will do a ubicomp project in the kitchen (similar to things we did in Munich) I will not use finger print scanners for authentication.

What would happen if I had to wash dishes before entering the US 😉

Panel on Users as Producers at Schloss Birlinghoven

In the castle on campus Ute Schütz and Michael Krapp from IAIS and SCAI organize a public panel discussion on citizen journalism and Web 2.0 trends. The discussion looked at the topic from several angles including technology, content, and communication. I had the honour to be on the panel with Wolfgang Back, Frank Patalong, Moritz „mo.“ Sauer and Thomas Tikwinski.

On issue was how much blogs are (mis)used to transport information or to do advertising. The web seems to be to many people a very believable medium. This reminded me of an article I read some time ago on story-telling o n the web (Miller, J. 2005. Storytelling evolves on the web: case study: EXOCOG and the future of storytelling. interactions 12, 1 (Jan. 2005), 30-47. DOI= http://doi.acm.org/10.1145/1041280.1041281). I think something along this lines would an interesting project with students.

The questions what is going to change in the near future on the WWW brought many trend statements out, but for me it is amazing that most of the infrastructure and technology we need to make this happen is out there. One comment which I think is really true is that it is more an more about content and communication again. As Thomas said before the panel – most of the great things that are called Web 2.0 have been in the original proposal for the WWW (e.g. annotations by everyone or users as editors) – but now technology is finally there that people can use it.

Girls‘ day at Fraunhofer in Birlinghoven

In Germany there are still too few girls and women interested in studying technical subjects – it may have different reasons but I think trying to convince young girls that technology is really exciting is a good way of addressing the problem.

We had this morning 7 girls visiting our lab. Matching our current teaching at B-IT (and using the test implementation Dagmar made 😉 we offered the topic “The computer knows where I am – how does this work”. First we played a mini geocaching game where they had to find a bag of jelly babies behind the castle.

After they had some experience with GPS and an electronic map we explained how it works and even parse together a NMEA-0183 sentence. We also discussed some application ideas, e.g. kids monitoring with GPS. The discussion, in particular the privacy issues that came up, were quite interesting.

I can really see that for some projects running focus groups with kids could be fun for them and a great value for the projects.

Why shopping is fun – thoughts on intelligent user interfaces or why n=1 is not enough

Some weeks ago I saw for the first time one of the intelligent scales in the wild (=outside the lab). At that time I was really impressed how well it worked (sample size: n=1, product: banana, pack: no-bag, recognition performance: 100%). Last time I was too late so there was no time to play or see other people using it – but today I had some 5 minutes to invest.

The basic idea of the scale is simple and quite convincing. The customers put their purchase on the scales. A camera makes a guess what it is and the selection menu is reduced to the candidates that match the guess of the camera. Additionally, there is always a button to get all the options (as in the old version without the camera). It appears that this should make things easier.

I observed people trying to weigh different fruits and vegetables in bags and without bags (obviously I tried it myself, too). It did not work very often but interestingly people did not care much. It looked as most people did not really realise that this is meant to be an intelligent user interface. They probably just wondered why the display is showing always different things, but as they are intelligent themselves they found a way to deal with.

Overall it seems that it does really well on bananas which are not wrapped in a bag (my initial test case) and does not too well on many other things. I think the scales are an interesting example of a invisible interface.

Overall this is again a remainder that user tests that are small may be utterly wrong.

A magic lens for the mass market?

Making things visible that can not be seen with the naked eye? Overlaying personalized information onto objects or images? Such concepts make good fiction but are there interesting use cases? Michael Rohs from T-Labs in Berlin visited B-IT and Fraunhofer IAIS today and he showed us in his talk and demos several such scenarios that appear not to be far in the future or fictional anymore.

Michael has developed during his PhD at ETH Zürich the Visual Codes system (http://people.inf.ethz.ch/rohs/visualcodes/) that provides a basis for augmented reality interaction on mobile phones. Some of his current work, in particular overlaying information on large paper maps, shows impressively the potential of using personal mobile devices, such as phones, as interfaces to combine static and dynamic information. I think for everyone trying out information overlays using a phone can easily imaging that this could be commonplace pretty soon. The question is more what the first pervasive and convincing applications are for mobile augmented reality and when will we find them in the wild. In our discussion a number of interesting application areas came up, in particular games and advertising seem very appealing.

In the morning Michael got a tour a B-IT and some demos. One of our tasks in the practical course developing location and context-aware systems is also related to a magic device from the Harry Potter book – a map with a moving point 😉

Till Schäfers, a student at B-IT who is currently at T-Labs in Berlin for his master thesis (supervised by Michael and me) gave this morning a presentation on the work he started. We had a longer discussion on issues of teleconferencing – and in particular on mobile teleconferencing – were many interesting ideas and issues came up. (Remark on research&realty: somehow it is sad that even after many year of research in teleconferencing the tools we use to do meeting over the phone in our daily work are still poor – but things are getting better). Another issue we discussed in detail is the questions of how to involve the user in the design process even more while giving at same time the user interface designer the freedom to designs and defines novel ways of interaction and exciting interfaces.

Besides the scientific exchange it is great to have visitors to learn about new gadgets. Michael and Till showed the SHAKE SK6 sensor /actuator attached to a phone – quite an interesting tool for research.

Steffi Beckhaus Showed us Virtual Reality beyond 3D Visual Displays

Steffi Beckhaus, who is professor for computer science at the University of Hamburg, visited our group at B-IT. Meeting her was another classical example how small the scientific community in user interface research is. I met Tanja Döring, one of Steffi’s students, at TEI’07 in Baton Rouge. They had a very interesting paper on novel user interfaces for art historians – “The Card Box at Hand: Exploring the Potentials of a Paper-Based Tangible Interface for Education and Research in Art History”. Looking then up Steffi Beckhaus details I saw that she was at Fraunhofer IMK (which is now part of IAIS) in Birlinghoven some year ago in the virtual environments group.

After lunch we had a few demos (like always on short notice as I forgot to tell before). Florian Alt demoed the current stage of his annotation platform for the web and Paul Holleis showed some examples of the work on modelling physical interaction and cross device prototyping, which we will present at CHI in 2 weeks. We also showed one of the student projects from the last course on developing mobile applications (CardiViz) and the ongoing work of our current lab on context and location awareness. We realized that we have very similar values and methods for teaching. In particular forcing students to bring in their own creativity into projects which they drive and for which we set a corridor seems a very efficient way to teach people who to create novel user experiences.

In her presentation Steffi showed us details about her lab in Hamburg (we were so impressed that we invited ourselves for a visit). In particular the combination of “classical VR” and tangible and novel user interfaces is intriguing. Overall her work is greatly interesting as it looks into the whole body experience (e.g. sound-floor, chairIO) and connects much more than I expected to our research theme of embedded interaction.

In our discussion Steffi brought up a video of the Pain-Station (http://www.fursr.com/) . It is basically a pong game where you get penalized for low performance with actuator that creates pain (I think with heat and a whip). To be successful you can either play well or take more pain than your opponent 😉 This led us to the discussion of how far one should go in designing novel user experiences.

Taking about tactile output Steffi mentioned the project VRIB (for more info see VRIB at Fraunhofer IMK or at Univeristy of Ilmenau) that was done from 2000 to 2004 on novel interaction devices and metaphors. This includes interesting issues that may be also relevant for our work on tactile output on mobile devices.