Interaction technologies for display environments

I was invited to give a talk on „Embedded interaction with display environments“ to discuss human computer interaction and technology issue for creating interactive display systems. The summer school has very diverse program! and I have enjoyed listening to my colleagues as much as presenting myself 🙂

In the talk I have a (more or less random) selection of technologies for making display environments interactive. There are the obvious vision based approaches (see the talk for the references) but I think there are many interesting approaches that are not yet fully explored. – including spatial audio location [1], eye tracking, and physiological sensors. Sebastian Boring create a focus and context input by combing different input technologies [2] – this can be especially interesting when scaling interaction up to larger surfaces. Additionally I think looking at the floor and the ceiling is worthwhile


Please feel free to add further technologies and approaches for creating interactive displays in the comment.

[1] James Scott, Boris Dragovic: Audio Location: Accurate Low-Cost Location Sensing. Pervasive Computing: Third International Conference, PERVASIVE 2005, Munich, Germany, May 8-13, 2005. Springer LNCS 3468/2005. pp 1-18. http://dx.doi.org/10.1007/11428572_1

[2] S. Boring, O. Hilliges, A. Butz. A Wall-sized Focus plus Context Display. In Proceedings of the Fifth Annual IEEE Conference on Pervasive Computing and Communications (PerCom), New York, NY, USA, Mar. 2007

It is better to look beautiful… Aesthetics and HCI

During the summerschool in Haifa Prof. Noam Tractinsky from Ben-Gurion University of the Negev gave a presentation about Aesthetics in Human-Computer Interaction. It was good to meet him in person and get some more insight in his work – as I refer to it typically in my HCI class.


In short his finding can be summarized by: What is Beautiful is Usable [1], [2]. In his talk he had some interesting example – you can look at a web page for one second only and you will figure out if it is a good design or not. There has been previous work in Japan [3] similar results – suggesting that this may be universial. Methodical I think the research approaches are not straightforward and may be disputed in parts – but the basic findings are very intuitive and should be taken more into account.

[1] Tractinsky, N. 1997. Aesthetics and apparent usability: empirically assessing cultural and methodological issues. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, United States, March 22 – 27, 1997). S. Pemberton, Ed. CHI ’97. ACM, New York, NY, 115-122. DOI= http://doi.acm.org/10.1145/258549.258626

[2] Tractinsky, N., Shoval-Katz A. and Ikar, D. (2000) What is Beautiful is Usable. Interacting with Computers, 13(2): 127-145.

[3] Kurosu, M. and Kashimura, K. 1995. Apparent usability vs. inherent usability: experimental analysis on the determinants of the apparent usability. In Conference Companion on Human Factors in Computing Systems (Denver, Colorado, United States, May 07 – 11, 1995). I. Katz, R. Mack, and L. Marks, Eds. CHI ’95. ACM, New York, NY, 292-293. DOI= http://doi.acm.org/10.1145/223355.223680

Interact 2009, Never been to Uppsala

Uppsala in Sweden is still one of the places I have never been to – and this year I missed another chance: Interact 2009

From our group Florian was there an presented his paper on a parasitic applications for the web [1]. We also published joined work with ETH ZĂŒrich on a comparison of product identification techniques on mobile devices [2]. Heiko Drewes has submitted his PhD thesis on Eye-tracking for interaction and one of the early projects he did was now published at Interact. The idea is that the mouse courser is positioned to the position where your eye-gaze is in the moment you touch the mouse [3]. Interact 2009 was quite competetive as it had an acceptance rate of 29% for research papers.

[1] Alt, F., Schmidt, A. Atterer, R., Holleis, P. 2009. Bringing Web 2.0 to the Old Web: A Platform for Parasitic Applications. Human-Computer Interaction – INTERACT 2009. 12th IFIP TC 13 International Conference, Uppsala, Sweden, August 24-28, 2009. Springer LNCS 5726. pp 405-418.
http://www.springerlink.com/content/vr175l725m7185m6/

[2] von Reischach, F., Michahelles, F.,Guinard, D.,Adelmann, R. Fleisch, E., Schmidt, A. 2009. An Evaluation of Product Identification Techniques for Mobile Phones. Human-Computer Interaction – INTERACT 2009. 12th IFIP TC 13 International Conference, Uppsala, Sweden, August 24-28, 2009. Springer LNCS 5726. pp 804-816
http://www.springerlink.com/content/740421515527855g/

[3] Drewes, H., Schmidt, A. 2009. The MAGIC Touch: Combining MAGIC-Pointing with a Touch-Sensitive Mouse. 2009. Human-Computer Interaction – INTERACT 2009. 12th IFIP TC 13 International Conference, Uppsala, Sweden, August 24-28, 2009. Part II. Springer LNCS 5727. pp 415-428
http://www.springerlink.com/content/m188522m6q5470l2/

Meeting Prof. Brian Randell, book recommendations

Yesterday after my talk I met briefly Prof. Brian Randell from the School of Computing Science at Newcastle University. Today we had a chat over a coffee and it is really interesting to think more about dependability implications of ubicomp technologies.

Besides many other points I got a set of interesting pointers to books:

Online Shop for Smart Materials and More

We are in Newcastle for a Workshop working on a new idea for tangible UIs that can be easily customized. The basic idea is to senparate functional parts of the system (electronics etc.) from the shell/tangible components of a devices. By this we hope to support innovation in a sustainable way. The skin of the appliance is printed (in 3D).

Nic Villar came up from Cambridge and he showed us some interesting materials… and obviously there is a shop (materials.
http://www.mutr.co.uk/) to get those… Look in the section for smart materials – there are probably many ideas hidden for now interface technologies – not only for tangible UIs.

We discussed how Polymorph could be used in tangible UIs – I think the challenge is to electronically control the material… obviously we played with the material to get ideas 🙂

Educating Inventers – News paper report about our work

The Newspaper RecklinghĂ€user Zeitung runs a series on inventers in the region. We were honored to be part of this. The article „Jede Menge Infos im CafĂ©-Tisch“ (in German) is online at Medienhaus Bauer.

The article made me think again how we can motivate students to invent new things and applications. It is always a trade-off between giving students a very open project (where some are very creative and others just try to find the minimum requirement but it is not really clear what exactly the learn) and providing a clear assignment (where there is little space for own ideas but it is very clear what skills are trained).

Reading material for summer school.

Tsvi Kuflik and Antonio KrĂŒger organize from August 30th – September 3rd a German-Israeli Minerva School for Ubiquitous Display Environments: Intelligent Group Interaction, Foundations and Implementation of Pervasive Multimodal Interfaces. I will teach a session on: „Embedded interaction with display environments“ and here is the list of recommended readings for the participants – if you are short on time only read the first one and glance over the other two.

Mahato, H., Kern, D., Holleis, P., and Schmidt, A. 2008. Implicit personalization of public environments using bluetooth. In CHI ’08 Extended Abstracts on Human Factors in Computing Systems (Florence, Italy, April 05 – 10, 2008). CHI ’08. ACM, New York, NY, 3093-3098. DOI= http://doi.acm.org/10.1145/1358628.1358813 (if you do not have access to ACM here is a copy on the web)

Schmidt, A.; van Laerhoven, K. 2001. How to build smart appliances? Personal Communications, IEEE. Volume 8, Issue 4, Aug 2001:66 – 71. DOI: 10.1109/98.944006. http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=944006 (if you do not have access to IEEE here is a copy on the web)

Villar N.; Schmidt A.; Kortuem G.; Gellersen H.-W. 2003. Interacting with proactive public displays. Computers and Graphics, Elsevier. Volume 27, Number 6, December 2003 , pp. 849-857(9). Draft Version „Interacting with proactive community displays“ online available.

Recommended Reading – why would I read about math during my holidays?

If you study computer science in Germany you get a fair bit of math to do – especially in the first year. It is not liked by all students
 Nevertheless I have a reading recommendation that has to do with mathematics. I came across the book some month ago in a railway station bookshop – and I immediately liked it 😉

Der MathematikverfĂŒhrer by Christoph Drösser. Sample Chapter (in German). Solutions to the stories in the book. Link to the page at Amazon.

The concept of the book is funny (at least I think so) as it put math together with real world questions. And these questions (that are defiantly not really relevant for the survival of mankind) make the book appealing. E.g. how many molecules of Goethe’s last breath are you breathing in? Or how far should you empty a bier can before you put it in the sand to minimize the risk of the can tipping over? Or what is the optimal distance to walk behind another person to optimize for visibility of leg length (this may be regarded sexist in the US, it’s OK in most parts of Europe)? The travelling sales man problem is also included in the book, wrapped as travelling politician.

The math does not really go beyond high school level but I have learned and revised some math while reading. I learned some interesting facts about the distribution of numbers (Benford’s law) – so do not cheat when you do studies or surveys – I will figure it out


The book is in German – I have not seen an English version of the book…