Automotive User Interface Workshop

At the German HCI conference (Mensch und Computer) I organized together with Paul Holleis and Klaus Bengler (BMW Group) a workshop on automotive user interfaces. We were surprised how many people work and research in this area in Germany and Austria.

The 9 talks showed a wide range of research results and questions ranging from activity recognition, search interfaces, cultural issues to research methods. Dagmar Kern presented our work on a new method for interviewing drivers at the gas station. Stefan Graf from BMW groups had an interesting demo on object oriented interaction and in-car text input.

In the final session we discussed on future challenges of automotive user interfaces and it seems that it is a great challenge as cars are very emotional products. One interesting point was that user interfaces may not be central for the decisions which car to buy – but if not satisfied it will influence the decisions not to buy such a car again.

Context and context-awareness (e.g. based on user activity, driving parameters and location) seems to provide a great opportunity for future interfaces and in-car applications. One nice example was presented by Susanne Boll from a joint project with VW (C3World, connected cars in a connected world).

Ubiquitous, Pervasive and Ambient Computing – Clarification of Terms

In the resent month the question about ubiquitous, pervasive, ambient computing came up several times. An email by Jos Van Esbroeck motivated me to write my view on it…

Clarifying the terms seems an ongoing process as various communities and individuals use each of those terms for new things they are doing.

For me the best way to discriminate the terms ubiquitous computing, pervasive computing, and ambient intelligence is by their origin, history and research communities.

The first term (ubiquitous computing, ubicomp) is linked to Mark Weiser and his vision of computing in the 21st century [1]. In the research community its is very much connected to ubiquitous and pervasive systems that have the user somewhere in the loop. The ubicomp conference [2] seems more focused on user experience than on pure technology.

Pervasive Computing was pushed in the mid 1990s, more by industry and in particular by IBM. Pervasive computing seems from its origin more focused on technologies and solutions than on a particular vision. The two major conferences related to this topic: pervasive [3] and percom [4] are more systems and network focused, however always keeping some attention to the user experience perspective. Here, in particular with percom, many in the research community have their origin in the networking and distributed systems world. To me pervasive computing seems more technical than ubiquitous computing and includes systems that do no have direct human users involved.

The term ambient intelligence was introduced by the European funding agencies in the Framework 5 vision. Around the same time as the Philips Home-lab that drives the term, too. Here, similar to ubicomp, the vision of a new quality of user experience is a driving factor. The research that falls under this label by now is broad and I think it is very similar to the research in ubiquious computing. There is also a European conference on ambient intelligence [5].

Many people that are involved in ubicomp/pervasive/percom are also active in one more traditional research community. In particular many people are additionally involved in user interface research (e.g. CHI-Community), mobile computing and mobile systems, networking and distributed systems.

A very early topic related to the whole field is context-awareness as introduced by Schilit [6] who was working with Weiser. In my PhD dissertation I have looked more into the relationship between ubicomp and context-awareness – it has the title Ubiquitous Computing – Computing in Context [7]

In parallel subtopic in the above field have emerged that look at specific aspects, e.g. internet of things [8] (not necessarily a human in the loop), wearable computing (computing in cloth), smart environments (computing in buildings and furniture), tangible and embedded interaction [9] (looking at the interaction side), smart objects, … and probably many more.

There is also an interesting trend that many of the topics, if they are a bit matured, move back into the traditional communities.

[1] Mark Weiser. The Computer for the Twenty-First Century. Scientific American 265, 3 (September 1991), 94-104
[2] http://www.ubicomp.org/
[3] http://pervasive2008.org/
[4] http://www.percom.org/
[5] http://www.ami-07.org/
[6] B. Schilit, N. Adams, and R. Want. (1994). „Context-aware computing applications„. IEEE Workshop on Mobile Computing Systems and Applications (WMCSA’94), Santa Cruz, CA, US: 89-101 .
[7] Albrecht Schmidt(2003). „Ubiquitous Computing – Computing in Context„. PhD dissertation, Lancaster Univeristy.
[8] http://
www.internetofthings-2008.org
[9] http://www.tei-conf.org/

acatech workshop: object in context

It was interesting to see that smart objects / smart object services, context, NFC, and RFID become very mainstream. It seems that nearly everyone buys into these ideas now.

Dr. Mohsen Darianian (from Nokia Research, same building as Paul Holleis is at the moment) showed an NFC-advert video which reminded me on the results of an exercise we did on concept videos within an HCI-class at the University of Munich 🙂

Overall it seems that acceptance and business models are of great interest and that to create them a lot of technical insight is required. The issues related to user interfaces, interaction, experience become central factors for the success of products and services.

One discussion was on the motivation for people to contribute (e.g. user generated content, write open source code, answer questions in forums, blogs). Understanding this seem crucial to the prediction whether or not a application is going to fly or not.

Besides contributing for a certain currency (e.g. fame, status, money, access to information) it seems that altruism may be an interesting factor for motivating potential users. Even if it is a low percentage within our species the absolute number on a world wide scale could be still enough to drive a certain application/service. There is interesting research on altruism in the animal world (or at the researchers page http://email.eva.mpg.de/~warneken/ ) maybe we should look more into this and re-think some basic assumptions on business models?

Our break out group was in the rooms of the Institute of Electronic Business e.V (http://www.ieb.net/). It is a very pleasant environment and their link to the art school reflects very positive on the atmosphere and projects. The hand drawn semacodes were really impressive.

Pervasive 2007 in Toronto

The internatonal conference on pervasive computing in Toronto had an exiting program.

The keynote was by Adam Greenfield on “Everyware: Some Social and Ethical Implications of Ubiquitous Computing” – matching a number of issues we discussed the day before at the doctoral colloquium. The talk was enjoyable even though I think some of the statements made, in particular with regard to opting out and informing the users (e.g. logos) are over-simplified. Furthermore the fact that our society and its values are changing was very little reflected, e.g. privacy is not a constant.

The best paper (by Rene Mayerhofer and Hans Gellersen) “Shake well before use: Authentication based on accelerometer data” was my favourite, too. A further very interesting paper was “Inference Attacks on Location Tracksby John Krumm. Two papers from ETH Zürich were also quite interesting: “Operating Appliances with Mobile Phones – Strengths and Limits of a Universal Interaction Deviceby Christof Roduner et al. showed surprising results for the use of phones as remote control (in short – more usable than one thinks). And “Objects Calling Home: Locating Objects Using Mobile Phones” by Christian Frank et al. showed that phones have a great utility as sensors (in this case to find lost objects.)

We presented a in the video proceedings the smart transport container and a novel supply chain scenario (cutting out all intermediaries and enabling producer to customer transactions).

The tutorial day was excellent – I think the set of tutorials presented can give a good frame for preparing a course or lecture on pervasive computing.

Pervasive 2008 will be in Australia!

Pervasive Computing and Ethics

Together with Boriana Koleva I organized the doctoral colloquium at Pervasive 2007 in Toronto. We had 9 students presenting and discussing their PhD work with us.

One central observation was that we come to a point where we have to make more and more ethical decisions. Many things that are technical feasible and harmless within the lab may have sincere implications in the real world. If technologies for tracking, tracing and mining (e.g. social network analysis, location based services, context-aware systems) are deployed beyond the lab the question of choice becomes a real issue – are users aware of it and can they opt-out?

In the area of context-awareness technology has moved on since I started my PhD on the topic nearly 10 years ago – but amazingly scenarios did change little. Automatically detecting a meeting is still on the students slides. The more I learn and understand about context-awareness the more it becomes apparent that this apparently simple use case is amazingly hard!

Our Presentations at CHI’07 in San Jose

At this years CHI the Conference on Human Factors in Computing Systems we presented 3 contributions: a full paper, a CHI-note, and a work in progress paper. Have a look at them!

Holleis, P., Otto, F., Hussmann, H., and Schmidt, A. 2007. Keystroke-level model for advanced mobile phone interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA, April 28 – May 03, 2007). CHI ’07. ACM Press, New York, NY, 1505-1514. DOI= http://doi.acm.org/10.1145/1240624.1240851

Atterer, R. and Schmidt, A. 2007. Tracking the interaction of users with AJAX applications for usability testing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA, April 28 – May 03, 2007). CHI ’07. ACM Press, New York, NY, 1347-1350. DOI= http://doi.acm.org/10.1145/1240624.1240828

Holleis, P., Kern, D., and Schmidt, A. 2007. Integrating user performance time models in the design of tangible UIs. In CHI ’07 Extended Abstracts on Human Factors in Computing Systems (San Jose, CA, USA, April 28 – May 03, 2007). CHI ’07. ACM Press, New York, NY, 2423-2428. DOI= http://doi.acm.org/10.1145/1240866.1241018

Tangible and Embedded Interaction 2007

Just a little more than week before the Tangible and Embedded Interaction 2007 starts in Baton Rouge (http://www.tei-conf.org/).

The program looks really exciting – a mixture of computer science, HCI, design, and art. I would expect that the conference sparks a lot of new ideas. Brygg Ullmer did the cover for the proceedings and it looks really cool.

Having seen the program of TEI’07 we have decided to put in a proposal to run the conference next year in Bonn. Hope we get it…