Automotive UI in Salzburg

Manfred Tscheligi opend the Automotive UI conference in Salzburg. The conference is now in its 3rd year after 2009 in Essen and 2010 in Pittsburgh. The conference is growing – there were well over 130 people registered 🙂

The proceedings of the conference series are online available at http://auto-ui.org

3rd Auto-UI Proceedings 2011 (soon in the ACM DL)
2nd Auto-UI Proceedings 2010 (ACM DL)
1st Auto-UI Proceedings 2009 (ACM DL)

Guests in my multimodal interaction class

Today I had brought 3 more professors with me to teach the class on multimodal interaction (I learned from Hans). As we have the pd-net project meeting Nigel Davies, Marc Langheirich, and Rui Jose were in Stuttgart and ‘volunteered’ to give a talk.

Nigel talked about the work in Lancaster on the use of mobile computing technology to support sustainable travel. He explained the experiments they conducted for collecting and sharing travel related information. In the 6th Sense Transport project they look beyond looking at understanding the current context into predictions and eventually ‘time travel’ 😉

Marc presented a one hour version of his tutorial on privacy introducing the terminology and explaining the many facets this topic has. We discussed the ‘NTHNTF’ argument (Nothing To Hide Nothing To Fear) and Marc used an example of AOLstalker.com to show the weaknesses of this argument. Marc suggested some reading if you want to dive into the topic, see [1,2,3,4].

Rui focused in his lecture on pervasive public displays. He gave an overview of typical architectures for digital signage systems and the resulting limitation. The pd-net approach aims at creating an open platform that allows many different applications and use cased. He showed once concept of using virtual pin-badges to trigger content and to express interest in a certain topic.

There is more information on the pd-net project on http://pd-net.org

[1] David Brin. The Transparent Society. Perseus Publishing, 1999.
[2] Simson Garfinkel: Database Nation – The Death of Privacy in the 21st Century. O’Reilly, 2001.
[3] Lawrence Lessig: Code and Other Laws of Cyberspace. Basic Books, 2006. http://codev2.cc/
[4] Waldo, Lin, Millett (eds.): Engaging Privacy and Information Technologygy in a Digital Age. National Academies Press, 2007.

Call for Papers: Symposium on Pervasive Display Networks

Rui José and Elaine Huang are chairing an international symposium on pervasive displays in Portugal. The conference will be held June 4-5 2012 in Porto. The submission deadline for full papers is January 16th, 2012.

With our research in the PD-net project we encounter many interesting research questions and met with many other researchers interested in the topic. It seems that the many real deployments of electronic displays is fueling ideas and makes it obvious that research is required to understand the properties of this new upcoming media. The call states: “As digital displays become pervasive, they become increasingly relevant in many areas, including advertising, art, sociology, engineering, computer science, interaction design, and entertainment.

We hope with this symposium we will bring together researchers and practitioners as well as users to share research results and generate new ideas.

Submissions that report on cutting-edge research in the broad spectrum of pervasive digital displays are invited, ranging from large interactive walls to personal projection, from tablets and mobile phone screens to 3-D displays and tabletops. Topics include:

  • Novel technologies
  • Architecture
  • Applications
  • Domains and formative studies studies
  • Evaluations and deployments
  • Interfaces and interaction techniques
  • Content design

Have a look at the webpage and the call for paper at http://pervasivedisplays.org/cfp.php

Closing Keynote at AMI2011, Beyond Ubicomp – Computing is Changing the Way we Live

On Friday afternoon I had the privilege to present the closing keynote at AMI2011 in Amsterdam with the title ‘Beyond Ubicomp – Computing is Changing the Way we Live’. The conference featured research in Ambient Intelligence ranging from networking and system architecture to interfaces and ethnography. It brought an interesting set of people together and it was good to see many students and young researchers presenting their work.

In my closing keynote at talked about my experience of the last 13 years in this field and about a vision of the future. My vision is based on a basic technology assessment – basically looking what technologies will (in my view) definitely come over the next 20 years and looking at the implications of this. I stared out with a short reference to Mark Weiser’s now 20 year old article [1]. The upcoming issue of IEEE Pervasive Magazine will have a in-depth analysis of the last 20 years since Weiser‘ article – we have also an article in there on how interaction evolved.

The vision part of the talk looked „Perception beyond there here and now“ [2] from 3 different angles:

  • Paradigm Shift in Communication
    Here I argue that the default communication in the future will be public communication and only if something is secret we will try to use non public channel. First indicators of this are a switch from email to twitter and facebook. I used a cake baking example to highlight the positive points of this shift.
  • Steep Increase in media capture
    The second angle is just observing and extrapolating the increase in capture of media information. If you go already now on youtube you will information about many things (backing a cake, repairing a bike, etc.). The implication of this increase in media capture will be virtually unlimited access to experience other people share
  • Transformation of experienced perception
    The final angle is that this creates a new way of perceiving the world. We will extent perception beyond the here and now and this is bringing a completely new way of creating and accessing information. I used the example of enquiring about buying an international train ticket at the station in Amsterdam. If you can look there through other people’s eyes the question becomes trivial.

My overall argument is that we are in for a major transformation of our knowledge and information culture. I would expect that this shift is as radical as the shift from an oral tradition to the written societies – but the transition will be much quicker and in the context of a globalized and competitive world.

The main conclusion from this is: Ethics and values are the central design material of this century.

Looking at twitter it seems it got across to some in the audience 😉 If your are interested, too have a look at the slides from the keynote.

[1] Mark Weiser. The computer for the 21st century. Scientific American, Vol. 265, No. 3. (1991)
[2] Albrecht Schmidt, Marc Langheinrich, and Kritian Kersting. 2011. Perception beyond the Here and Now. Computer 44, 2 (February 2011), 86-88. DOI=10.1109/MC.2011.54 http://dx.doi.org/10.1109/MC.2011.54

Keynote: Steve Benford talking on „Designing Trajectories Through Entertainment Experiences“

On Tuesday morning Steve Benford presented the entertainment interfaces keynote. He is interested in how to use computer technology to support performances. Steve works a lot with artist group, where the University is involved in implementing, running and studying the experiences. The studies are typically done by means of ethnography. The goal of this research is to uncover the basic mechanisms that make these performances work and potentially transfer the findings to human computer interaction in more general.

I particularly liked the example of „Day of the figurines„. Steve showed the video of experiences they created and discussed the observations and findings in detail. He related this work to the notion of trajectories [1], [2]. He made the point that historic trajectory are especially well suited to support spectators.

Some years back I worked with Steve in the Equator and we even have a jointed publication [3] 🙂 When looking for these references I came across another interesting paper – related to thrill and excitement, which he discussed in the final part of the talk [4].

PS: we had a great party on Monday night but the attendance was extremly good 🙂

[1] Benford, S. and Giannachi, G. 2008. Temporal trajectories in shared interactive narratives. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 – 10, 2008). CHI ’08. ACM, New York, NY, 73-82. DOI= http://doi.acm.org/10.1145/1357054.1357067

[2] Benford, S., Giannachi, G., Koleva, B., and Rodden, T. 2009. From interaction to trajectories: designing coherent journeys through user experiences. In Proceedings of the 27th international Conference on Human Factors in Computing Systems (Boston, MA, USA, April 04 – 09, 2009). CHI ’09. ACM, New York, NY, 709-718. DOI= http://doi.acm.org/10.1145/1518701.1518812

[3] Benford, S., Schnädelbach, H., Koleva, B., Anastasi, R., Greenhalgh, C., Rodden, T., Green, J., Ghali, A., Pridmore, T., Gaver, B., Boucher, A., Walker, B., Pennington, S., Schmidt, A., Gellersen, H., and Steed, A. 2005. Expected, sensed, and desired: A framework for designing sensing-based interaction. ACM Trans. Comput.-Hum. Interact. 12, 1 (Mar. 2005), 3-30. DOI= http://doi.acm.org/10.1145/1057237.1057239

[4] Schnädelbach, H., Rennick Egglestone, S., Reeves, S., Benford, S., Walker, B., and Wright, M. 2008. Performing thrill: designing telemetry systems and spectator interfaces for amusement rides. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 – 10, 2008). CHI ’08. ACM, New York, NY, 1167-1176. DOI= http://doi.acm.org/10.1145/1357054.1357238

Opening Keynote of Mensch&Computer 2010 by Ed H. Chi

Ed H. Chi from PARC presented the opening keynote for Mensch&Computer 2010. In the motivation of the talk he showed a document on „Applied Information processing psychology“ from 1971 – probably very few had seen this before. It makes an argument for an experimental science that is related to augmented cognition. The basic idea is very similar to Vannevar Bush’s Memex – to extend the human cognitive power by machines (and especially computer technology). It is apparent that these ideas became the backdrop of the many innovations that happened at PARC in the early days.

Ed stressed that there is still a lot of potential for the application of psychological phenomena and models to human computer interaction research. As an example he used the idea that speech output in a navigation system could use your name in an important situation making use of the attenuation theory of attention (the cocktail party effect). By hearing your name you are more likely to listen – even if you are yourself in a conversation. The effect may be stronger if the voice is your mother’s voice 😉

The main part of the talk centered on model driven research in HCI. Using the ScentHighlights [1] examples he outlined the process. I liked very much the broad view Ed has on models and the various uses of models he suggested, e.g. generative models that generate ideas; or behavioral models that lead to additional functionalities (as example he used: people are sharing search results in google, hence sharing should be a basic function in a search tool). Taking the example of Wikipedia he showed how models can be used to predict interaction and growth. I found the question on the growth of knowledge very exciting. I think it is defiantly not finite 😉 otherwise research is a bad career choice. Looking at the Wikipedia example it is easy to imagine that the carrying capacity is a linear function and hence one could use a predictive function where a logistic growth curve is overlayed with a linear function.

Random link from the talk: http://mrtaggy.com/

Ed discussed yahoo’s social pattern library:
http://developer.yahoo.com/ypatterns/social/people/reputation/
This pattern library is pretty interesting. I found the reputation pattern pretty comprehensive. It seems that this library is now comprehensive enough for using it for real and in teaching.

[1] Chi, E. H., Hong, L., Gumbrecht, M., and Card, S. K. 2005. ScentHighlights: highlighting conceptually-related sentences during reading. In Proceedings of the 10th international Conference on intelligent User interfaces (San Diego, California, USA, January 10 – 13, 2005). IUI ’05. ACM, New York, NY, 272-274. DOI= http://doi.acm.org/10.1145/1040830.1040895

Talk at the University of New Hampshire, Durham

Andrew Kun invited me to give a talk at the Univeristy of New Hampshire in Durham on my way back from CHI. The talk was on „Embedding Interaction – Human Computer Interaction in the Real World“. In the afternoon I got to see interesting projects in the automotive domain as well as an application on a multi-touch table. At CHI we ran a SIG on Automotive User Interfaces [1].

Seeing the implementation of Project54 live was very exciting. I came across the project first at Pervasive 2005 in Munich [2]. This project is an interesting example of how fast research can become deployed on a large scale.

Andrew chairs together with Susanne Boll the 2nd Int. Conf. on Automotive User Interfaces and Interactive Vehicular Applications – check out the call for papers on http://auto-ui.org/! (deadline 2nd of July 2010)

PS: if you ever stay in Durham – here is my favorite hotel: Three Chimneys Inn Durham.

[1] Schmidt, A., Dey, A. K., Kun, A. L., and Spiessl, W. 2010. Automotive user interfaces: human computer interaction in the car. In Proceedings of the 28th of the international Conference Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA, April 10 – 15, 2010). CHI EA ’10. ACM, New York, NY, 3177-3180. DOI= http://doi.acm.org/10.1145/1753846.1753949

[2] Laslo Turner and Andrew L. Kun, “Evaluating the Project54 speech user interface,” Third International Conference on Pervasive Computing (Adjunct Proceedings), Munich, Germany, May 8-13, 2005

Our Paper and Note at CHI 2010

Over the last year we looked more closely into the potential of eye-gaze for implicit interaction. Gazemarks is an approach where the users‘ gaze is continuously monitored and when leaving a screen or display the last active gaze area is determined and store [1]. When the user looks back at this display this region is highlighted. By this the time for attention switching between displays was in our study reduced from about 2000ms to about 700ms. See the slides or paper for details. This could make the difference that we enable people to safely read in the car… but before this more studies are needed 🙂

Together with Nokia Research Center in Finland we looked at how we can convey the basic message of an incoming SMS already with the notification tone [2]. Try the Emodetector application for yourself or see the previous post.

[1] Kern, D., Marshall, P., and Schmidt, A. 2010. Gazemarks: gaze-based visual placeholders to ease attention switching. In Proceedings of the 28th international Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA, April 10 – 15, 2010). CHI ’10. ACM, New York, NY, 2093-2102. DOI= http://doi.acm.org/10.1145/1753326.1753646

[2] Sahami Shirazi, A., Sarjanoja, A., Alt, F., Schmidt, A., and Hkkilä, J. 2010. Understanding the impact of abstracted audio preview of SMS. In Proceedings of the 28th international Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA, April 10 – 15, 2010). CHI ’10. ACM, New York, NY, 1735-1738. DOI= http://doi.acm.org/10.1145/1753326.1753585

PS: the social event was at the aquarium in Atlanta – amazing creatures! Again supprised how well the N95 camera works even under difficult light conditions…

Work in Progress at CHI 2010

It seems we have a lot of work in progress 🙂 and CHI is a great place to get feedback an talk to people about it.

Florian Alt and others from the summer school in Haifa pushed one of the ideas the developed there further. It is about interactions and technologies to motivate a more thoughtful handling of trash in urban areas [1].

Tanja Döring and Bastian Pfleging developed with Chris Kray in Nottingham the idea of tangible devices that have a functional core and a passive shell [2]. By this we image that future tangible products can be created by designers and developers with no need for the production of electronics. As a side effect this approach could make consumer electronics more sustainable – even if you like often new gadgets.

Together with people from DFKI Saarbrücken we explored the potential of a multi-touch steering wheel [3]. What gestures would you do to switch on your radio? How to interact with the navigation system? Such questions are empirically explored and presented in this paper.

How many people have a phone? How many people have a PC? It very clear more people have a phone than a PC and in particular in the non-industrial part of the world for many people the only computing technology available is the phone. We think there are ways to efficiently develop software using a phone for the phone. In the paper we explored a paper and computer vision based approach for software development on the phone [4].

Elba did field studies in Panama to assess the access of phones as educational tool to children [5]. She compared different parts of the country and did interviews with teachers.

[1] Reif, I., Alt, F., Hincapié Ramos, J., Poteriaykina, K., and Wagner, J. 2010. Cleanly: trashducation urban system. In Proceedings of the 28th of the international Conference Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA, April 10 – 15, 2010). CHI EA ’10. ACM, New York, NY, 3511-3516. DOI= http://doi.acm.org/10.1145/1753846.1754010

[2] Doering, T., Pfleging, B., Kray, C., and Schmidt, A. 2010. Design by physical composition for complex tangible user interfaces. In Proceedings of the 28th of the international Conference Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA, April 10 – 15, 2010). CHI EA ’10. ACM, New York, NY, 3541-3546. DOI= http://doi.acm.org/10.1145/1753846.1754015

[3] Pfeiffer, M., Kern, D., Schöning, J., Döring, T., Krüger, A., and Schmidt, A. 2010. A multi-touch enabled steering wheel: exploring the design space. In Proceedings of the 28th of the international Conference Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA, April 10 – 15, 2010). CHI EA ’10. ACM, New York, NY, 3355-3360. DOI= http://doi.acm.org/10.1145/1753846.1753984

[4] Pfleging, B., Valderrama Bahamondez, E. d., Schmidt, A., Hermes, M., and Nolte, J. 2010. MobiDev: a mobile development kit for combined paper-based and in-situ programming on the mobile phone. In Proceedings of the 28th of the international Conference Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA, April 10 – 15, 2010). CHI EA ’10. ACM, New York, NY, 3733-3738. DOI= http://doi.acm.org/10.1145/1753846.1754047

[5] Valderrama Bahamóndez, E. d. and Schmidt, A. 2010. A survey to assess the potential of mobile phones as a learning platform for panama. In Proceedings of the 28th of the international Conference Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA, April 10 – 15, 2010). CHI EA ’10. ACM, New York, NY, 3667-3672. DOI= http://doi.acm.org/10.1145/1753846.1754036