Interact 2009, Never been to Uppsala

Uppsala in Sweden is still one of the places I have never been to – and this year I missed another chance: Interact 2009

From our group Florian was there an presented his paper on a parasitic applications for the web [1]. We also published joined work with ETH Zürich on a comparison of product identification techniques on mobile devices [2]. Heiko Drewes has submitted his PhD thesis on Eye-tracking for interaction and one of the early projects he did was now published at Interact. The idea is that the mouse courser is positioned to the position where your eye-gaze is in the moment you touch the mouse [3]. Interact 2009 was quite competetive as it had an acceptance rate of 29% for research papers.

[1] Alt, F., Schmidt, A. Atterer, R., Holleis, P. 2009. Bringing Web 2.0 to the Old Web: A Platform for Parasitic Applications. Human-Computer Interaction – INTERACT 2009. 12th IFIP TC 13 International Conference, Uppsala, Sweden, August 24-28, 2009. Springer LNCS 5726. pp 405-418.
http://www.springerlink.com/content/vr175l725m7185m6/

[2] von Reischach, F., Michahelles, F.,Guinard, D.,Adelmann, R. Fleisch, E., Schmidt, A. 2009. An Evaluation of Product Identification Techniques for Mobile Phones. Human-Computer Interaction – INTERACT 2009. 12th IFIP TC 13 International Conference, Uppsala, Sweden, August 24-28, 2009. Springer LNCS 5726. pp 804-816
http://www.springerlink.com/content/740421515527855g/

[3] Drewes, H., Schmidt, A. 2009. The MAGIC Touch: Combining MAGIC-Pointing with a Touch-Sensitive Mouse. 2009. Human-Computer Interaction – INTERACT 2009. 12th IFIP TC 13 International Conference, Uppsala, Sweden, August 24-28, 2009. Part II. Springer LNCS 5727. pp 415-428
http://www.springerlink.com/content/m188522m6q5470l2/

Maps – still the tool for navigation in the mountains

On Saturday we went to Garmisch and walked up to Höllentalklamm (a nice canyon) and had lunch at Höllentalangerhütter. Our GPS tracking data from the canyon was pretty poor (as one would expect as the canyon is in parts only a few meters wide).

Observing other hikers (especially people who did the larger tours) it was very interesting to see how maps are used in social situations – planning, discussion, reflection, and storytelling (this time n>10). It is hard to image how this experience can be replaced by an implementation on a mobile device.

Will we have to wait till we have 1 meter by 1 meter foldable e-ink displays with 200dpi? Or are there other means to implement a good hiking map on a mobile phone screen? There is a lot of ongoing research in this domain. For driving I would guess the paper map has been largely replaced by electronic devices – when will it happened for hiking?

My guess is that traditional hiking maps will be the standard tool for another 10 years – obviously combined with a mobile device with GPS (e.g. phone, watch, or specific hiking GPS). There many ideas on how to do this – Johannes Schöning and Michael Rohs have worked on that for a while. The WIP they hat at CHI is an interesting example [1] or see the video on youtube.

Projector phones are a hot topic – Enrico had some interesting work on interaction with projector phones at Mobile HCI 2008 [2] & [3]. I would expect that in a years time we will see quite a number of those devices on the market.

[1] Schöning, J., Rohs, M., Kratz, S., Löchtefeld, M., and Krüger, A. 2009. Map torchlight: a mobile augmented reality camera projector unit. In Proceedings of the 27th international Conference Extended Abstracts on Human Factors in Computing Systems (Boston, MA, USA, April 04 – 09, 2009). CHI EA ’09. ACM, New York, NY, 3841-3846. DOI= http://doi.acm.org/10.1145/1520340.1520581

[2] Hang, A., Rukzio, E., and Greaves, A. 2008. Projector phone: a study of using mobile phones with integrated projector for interaction with maps. In Proceedings of the 10th international Conference on Human Computer interaction with Mobile Devices and Services (Amsterdam, The Netherlands, September 02 – 05, 2008). MobileHCI ’08. ACM, New York, NY, 207-216. DOI= http://doi.acm.org/10.1145/1409240.1409263

[3] Greaves, A. and Rukzio, E. 2008. Evaluation of picture browsing using a projector phone. In Proceedings of the 10th international Conference on Human Computer interaction with Mobile Devices and Services (Amsterdam, The Netherlands, September 02 – 05, 2008). MobileHCI ’08. ACM, New York, NY, 351-354. DOI= http://doi.acm.org/10.1145/1409240.1409286

DFG Emmy Noether Meeting in Potsdam, Art, Ceilings

Meeting with other researchers that run or have run Emmy Noether research groups is very different from normal conferences and meetings. The participants are across all disciplines – from art history to zoology 😉 The meeting focuses mainly on strategic, political, personal, administrative and organizational issues when starting a research career. This year we had child care organized during the meeting and Vivien came with me to Potsdam.

On Saturday night I learned that we (our galaxy) will eventually collide with the Andromeda Galaxy (but after our sun is out fuel – so I do not worry too much). Vivien found this fascinating, too. Learning more about astrophysics (looks defiantly more complicated than the things I usually do) teaches me to worry less about the immediate usefulness and direct utility of research results – also in our domain.

I am fascinated how different research can be and at the same time how similar the enthusiasm is people have for their research. By now – being one of the old guys – I co-organized two workshops. One together with Dr. Hellfeier from DHV on how to negotiate for a professorship and one with Stefanie Scheu and Rainer Hirsch-Luipold on teaching and PhD-supervision.

I talked to Riko Jacob (CS at TU Munich) about teaching computer science in school and he showed me a picture of a tangible shortest path calculator (I took a photo of the photo ;-). Perhaps I have at some point time to play with the installation in Munich.

On Sunday morning we took the water taxi – direct from the hotel peer – to the central train station in Potsdam. Christian Scholl from Göttingen (he does Art History) took some time to show us around the castle Sans Souci. After our discussion I wondered if we should consider a joint seminar from computer science/media informatics and art history – in particular ideas related to ambient media, interactive facades, and robotic buildings would benefit from a more historic awareness. There is an interesting PhD thesis on ceiling displays [1] – for a shorter version see [2]. I met Martin Tomitsch at a Ubicomp DC and I was impressed with the idea and its grounding in history.

[1] Tomitsch M. (2008). Interactive Ceiling – Ambient Information Display for Architectural Environments. PhD Thesis, Vienna University of Technology, Austria.

[2] Tomitsch, M., Grechenig, T., Vande Moere, A. & Sheldon, R. (2008). Information Sky: Exploring Ceiling-based Data Representations. International Conference on Information Visualisation (IV08), London, UK, 100-105. http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?tp=&arnumber=4577933&isnumber=4577908

Auto-UI Conference accepts 12 full papers and 10 notes

For the 1st International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI 2009) we got many quality submissions. The review process is now complete and we accepted 12 full papers and 10 notes for oral presentation at the conference. The list of accepted contributions is online at auto-ui.org.

As a number of people have asked if the still can submit to the program and as many of the rejected papers raise interesting aspects we decided to have Posters as a further submission category. We have a continuous submission process for poster abstracts till Sept 1st 2009. Earlier submissions receive feedback within 2 weeks. For details see the poster call for AutomotiveUI 2009.

If you submit somit your poster abstract during the next week, you will get the notification before the early registration deadline, which is August 6, 2009.

The registration is open and the conference is held in Essen, Mon/Tue 21 – 22 September 2009 – right after mobile HCI 2009 (which is in Bonn, just 100km away).

Morten Fjeld visiting

On his way from Eindhoven to Zurich Morten Fjeld was visiting our group. It was great to catch up and talk about a number of exciting research projects and ideas. Some years ago one of my students from Munich did his final project with Morten working on haptic communication ideas, see [1]. Last year at TEI Morten had a paper on a related project – also using actuated sliders, see [2].

In his presentation Morten gave an overview of the research he does and we found a joint interest in capacitive sensing. Raphael Wimmer did his final project in Munich on capacitive sensing for embedded interaction which was published in Percom 2007, see [3]. Raphael has continued the work for more details and the open source hardware and software see http://capsense.org. Morten has a cool paper (combing a keyboard and capacitive sensing) at Interact 2009 – so check the program when it is out.

We talked about interaction and optical tracking and that reminded me that we wanted to see how useful the touchless SDK (http://www.codeplex.com/touchless) could be for final projects and exercise. Matthias Kranz had used it successfully with students in Linz in the unconventional user interfaces class.

[1] Jenaro, J., Shahrokni, A., Schrittenloher, and M., Fjeld, M. 2007. One-Dimensional Force Feedback Slider: Digital platform. In Proc. Workshop at the IEEE Virtual Reality 2007 Conference: Mixed Reality User Interfaces: Specification, Authoring, Adaptation (MRUI07), 47-51

[2] Gabriel, R., Sandsjö, J., Shahrokni, A., and Fjeld, M. 2008. BounceSlider: actuated sliders for music performance and composition. In Proceedings of the 2nd international Conference on Tangible and Embedded interaction (Bonn, Germany, February 18 – 20, 2008). TEI ’08. ACM, New York, NY, 127-130. DOI= http://doi.acm.org/10.1145/1347390.1347418

[3] Wimmer, R., Kranz, M., Boring, S., and Schmidt, A. 2007. A Capacitive Sensing Toolkit for Pervasive Activity Detection and Recognition. In Proceedings of the Fifth IEEE international Conference on Pervasive Computing and Communications (March 19 – 23, 2007). PERCOM. IEEE Computer Society, Washington, DC, 171-180. DOI= http://dx.doi.org/10.1109/PERCOM.2007.1

Some Interesting Papers and random Photos from Pervasive 2009

Pervasive 2009 had a really exciting program and provided a good overview of current research in pervasive and ubiquitous computing. Have a look at the proceedings of the pervasive 2009 conference. The Noh theater in Nara was a very special and enjoyable venue and it was organized perfectly – as one would expect when travelling to Japan.

The idea of having short and long papers together in the main track worked very well in my view. The number of demos and posters was much higher than in the years before – and that was great and very inspiring. Have a look at the photos for some of the posters and demos.
The program consisted of 20 full papers (18 pages) and 7 notes (8 pages) which were selected in a peer review process out of 147 submissions (113 full papers, 34 notes) which is a acceptance rate of 18%.

John Krumm presented his paper Realistic driving tips for location privacy – again having a good idea making the presentation interesting beyond its content (having review snippets in the footer of the slides – including a fake review). The paper explores the difficulties that arise when creating fake GPS tracks. He motivated that the probabilities need to be taken into account (e.g. you are usually on a road). I liked the approach and the paper is worthwhile to read. I think it could be interesting to compare the approach is not create the tracks but just share them between users (e.g. other people can use parts of my track as fake track and in return I get some tracks that I can use as fake tracks). http://dx.doi.org/10.1007/978-3-642-01516-8_4

If you phone knows where you are you can use this information to control your heating system. This was the basic idea of the research presented by Stephen Intille. They explored using GPS location of the users to automate control of the heating / air condition control in a house. It seems there is quite some potential for saving energy with technology typically used in the US (one temperature control for the whole house). In Europe where heating systems typically offer finer control (e.g. room level) the potential is probably larger.
http://dx.doi.org/10.1007/978-3-642-01516-8_8

James Scott presented a paper that showed how you can use force gestures to interact with a device. In contrast to previous research (e.g. GUMMI) the approach works with a ridged device and could be used with current screen technologies.
http://dx.doi.org/10.1007/978-3-642-01516-8_10

What do you need to figure out who is holding and using the remote control? This question is addressed in the paper „Inferring Identity Using Accelerometers in Television Remote Controls“ that was presented by Jeff Hightower. They looked at how well button press sequences and accelerometer data give you information about which person is using the device.
http://dx.doi.org/10.1007/978-3-642-01516-8_11

Geo-fencing: confining Wi-Fi Coverage to Physical Boundaries is an example of how to create technological solutions to fit a user’s conceptual model of the world. As people have experience with the physical world and they have mechanisms to negotiate and use space and hence linking technologies that have typically other characteristics (e.g. wireless radio coverage) to the known concept is really interesting.
http://dx.doi.org/10.1007/978-3-642-01516-8_19

Situvis, a tool for visualizing sensor data, was presented by Adrian Clear from Aaron’s group in Dublin. The software, papers and a video is available at: http://situvis.com/. The basic idea is to have a parallel coordinate visualization of the different sensor information and to provide interaction mechanisms with the data.
http://dx.doi.org/10.1007/978-3-642-01516-8_22

Nathan Eagle presented the paper „Methodologies for continuous cellular tower data analysis“. He talked about the opportunities that arise when we have massive amounts of information from users – e.g. tracks from 200 million mobile phone user. It really is interesting that based on such methods we may get completely new insights into human behavior and social processes.
http://dx.doi.org/10.1007/978-3-642-01516-8_23

If you have seen a further interesting paper in the conference (and there are surely some) that I have missed feel free to give a link to them in the comments to this post.

Teaching, Technical Training Day at the EPO

Together with Rene Mayrhofer and Alexander De Luca I organized a technical training at the European Patent Office in Munich. In the lectures we made the attempt to give a broad overview of recent advanced in this domain – and preparing such a day one realizes how much there is to it…. We covered the following topic:
  • Merging the physical and digital (e.g. sentient computing and dual reality [1])
  • Interlinking the real world and the virtual world (e.g. Internet of things)
  • Interacting with your body (e.g. implants for interaction, brain computer interaction, eye gaze interaction)
  • Interaction beyond the desktop, in particular sensor based UIs, touch interaction, haptics, and Interactive surfaces
  • Device authentication with focus on spontaneity and ubicomp environments
  • User authentication focus on authentication in the public 
  • Location-Awareness and Location Privacy
Overall we covered probably more than 100 references – here are just a few nice ones to read: computing tiles as basic building blocks for smart environments [2], a bendable computer interface [3], a touch screen you can also touch on the back side [4], and ideas on phones as basis for people centric censing [5].
[1] Lifton, J., Feldmeier, M., Ono, Y., Lewis, C., and Paradiso, J. A. 2007. A platform for ubiquitous sensor deployment in occupational and domestic environments In Proceedings of the 6th Conference on international information Processing in Sensor Networks (Cambridge, Massachusetts, USA, April 25 – 27, 2007). IPSN ’07. ACM, New York, NY, 119-127. DOI= http://doi.acm.org/10.1145/1236360.1236377
[2] Naohiko Kohtake, et al. u-Texture: Self-organizable Universal Panels for Creating Smart Surroundings. The 7th Int. Conference on Ubiquitous Computing (UbiComp2005), pp.19-38, Tokyo, September, 2005. http://www.ht.sfc.keio.ac.jp/u-texture/paper.html
[3] Schwesig, C., Poupyrev, I., and Mori, E. 2004. Gummi: a bendable computer. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vienna, Austria, April 24 – 29, 2004). CHI ’04. ACM, New York, NY, 263-270. DOI= http://doi.acm.org/10.1145/985692.985726 
[4] Wigdor, D., Forlines, C., Baudisch, P., Barnwell, J., and Shen, C. 2007. Lucid touch: a seethrough mobile device. InProceedings of the 20th Annual ACM Symposium on User interface Software and Technology (Newport, Rhode Island, USA, October 07 – 10, 2007). UIST ’07. ACM, New York, NY, 269-278. DOI= http://doi.acm.org/10.1145/1294211.1294259 
[5] Campbell, A. T., Eisenman, S. B., Lane, N. D., Miluzzo, E., Peterson, R. A., Lu, H., Zheng, X., Musolesi, M., Fodor, K., and Ahn, G. 2008. The Rise of People-Centric Sensing. IEEE Internet Computing 12, 4 (Jul. 2008), 12-21. DOI= http://dx.doi.org/10.1109/MIC.2008.90  

HotMobile09: history repeats – shopping assistance on mobile devices

Comparing prices and finding the cheapest item has been a favorite application example over the last 10 years. I have seen the idea of scanning product codes and compare them to prices in other shops (online or in the neighborhood) first demonstrated in 1999 at the HUC conference. The Pocket BargainFinder [1] was a mobile device with a barcode reader attached that you could scan books and get a online price comparison. Since then I have seen a number of examples that take this idea forward, e.g. a paper here at HotMobile [2] or the Amazon Mobile App.

The idea of making a bargain is certainly very attractive; however I think many of these applications do not take enough into account how price building works in the real world. If the consumer gets more power in comparison it can go two was: (1) shops will get more uniform in pricing or (2) shows will make it again harder to compare. The version (2) is more interesting 😉 and this can range from not allowing the use of mobile devices in the shop (what we see in some areas at the moment) to more sophisticated pricing options (e.g. prices get lowered when you buy combinations of products or when you are repeatedly in the same shop). I am really curious how this develops – would guess the system will penetrate the market over the next 3 years…

[1] Adam B. Brody and Edward J. Gottsman. Pocket BargainFinder: A Handheld Device for Augmented Commerce. First International Symposium on Handheld and Ubiquitous Computing (HUC ’99), 27-29 September 1999, Karlsruhe, Germany
http://www.springerlink.com/content/jxtd2ybejypr2kfr/

[2] Linda Deng, Landon Cox. LiveCompare: Grocery Bargain Hunting Through Participatory Sensing. HotMobile 2009.

Demo day at TEI in Cambridge

What is a simple and cheap way to get from Saarbrücken to Linz? It’s not really obvious, but going via Stansted/Cambridge makes sense – especially when there is the conference on Tangible and Embedded Interaction (www.tei-conf.org) and Raynair offers 10€ flight (not sure about sustainability though). Sustainability, from a different perspective was also at the center of the Monday Keynote by Tom Igeo which I missed.

Nicolas and Sharam did a great job and the choice to do a full day of demos worked out great. The large set of interactive demos presented captures and communicates a lot of the spirit of the community. To get an overview of the demos one has to read through the proceedings (will post a link as soon as they are online in the ACM-DL) as there are too many to discuss them here.
Nevertheless here is my random pick:
One big topic is tangible interaction on surfaces. Several examples showed how interactive surfaces can be combined with physical artifacts to make interaction more graspable. Jan Borcher’s group showed a table with passive controls that are recognized when placed on the table and they provide tangible means for interaction (e.g. keyboard keys, knobs, etc.). An interesting effect is that the labeling of the controls can be done dynamically.
Microsoft research showed an impressive novel table top display that allows two images to be projected – on the interactive surface and one on the objects above [1]. It was presented at large year’s UIST but I have tried it out now for the first time – and it is a stunning effect. Have a look at the paper (and before you read the details make a guess how it is implemented – at the demo most people guessed wrong 😉
Embedding sensing into artifacts to create a digital representation has always been a topic in tangible – even back to the early work of Hiroshi Ishii on Triangles [2]. One interesting example in this year’s demo was a set of cardboard pieces that are held together by hinges. Each hinge is technically realized as a potentiometer and by measuring the potion the structure can be determined. It is really interesting to think this further.
Conferences like TEI let you inevitably think about the feasibility of programmable matter – and there is ongoing work in this in the robotics community. The idea is to create micro-robots that can create arbitrary shapes – for a starting point see the work at CMU on Claytronics.
[1] Izadi, S., Hodges, S., Taylor, S., Rosenfeld, D., Villar, N., Butler, A., and Westhues, J. 2008. Going beyond the display: a surface technology with an electronically switchable diffuser. In Proceedings of the 21st Annual ACM Symposium on User interface Software and Technology (Monterey, CA, USA, October 19 – 22, 2008). UIST ’08. ACM, New York, NY, 269-278. DOI= http://doi.acm.org/10.1145/1449715.1449760
[2] Gorbet, M. G., Orth, M., and Ishii, H. 1998. Triangles: tangible interface for manipulation and exploration of digital information topography. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Los Angeles, California, United States, April 18 – 23, 1998). C. Karat, A. Lund, J. Coutaz, and J. Karat, Eds. Conference on Human Factors in Computing Systems. ACM Press/Addison-Wesley Publishing Co., New York, NY, 49-56. DOI= http://doi.acm.org/10.1145/274644.274652

Two basic references for interaction byond the desktop

Following the workshop I got a few questions on what the important papers are that one should read to start on the topic. There are many (e.g. search in google schoolar for tangible interaction, physical interaction, etc and you will see) and there conference dedicated to it (e.g. the tangible and embedded interaction TEI – next week in cambridge).

But if I have to pick two here is my joice:

[1] Ishii, H. 2008. Tangible bits: beyond pixels. In Proceedings of the 2nd international Conference on Tangible and Embedded interaction (Bonn, Germany, February 18 – 20, 2008). TEI ’08. ACM, New York, NY, xv-xxv. DOI= http://doi.acm.org/10.1145/1347390.1347392

[2] Jacob, R. J., Girouard, A., Hirshfield, L. M., Horn, M. S., Shaer, O., Solovey, E. T., and Zigelbaum, J. 2008. Reality-based interaction: a framework for post-WIMP interfaces. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 – 10, 2008). CHI ’08. ACM, New York, NY, 201-210. DOI= http://doi.acm.org/10.1145/1357054.1357089