Christian Kray visits our Lab

Christian Kray and I were colleagues in Lancaster for a very short time – he just joined the university when I left for Munich. After his post-doc in Lancaster he moved to a position in Newcastle.

His work at the cross roads of mobile interaction and public displays is very exciting. In particular he investigates interesting concepts related to visual codes – some aspects to these ideas are discussed in “Swiss Army Knife meets Camera Phone” [1]. His new prototypes are really cool and I look forward to see/read more about them.

We realized that there are many areas where we have common interests. Perhaps there is a chance in the future to work together on some of the ideas discussed!

[1] Swiss Army Knife meets Camera Phone: Tool Selection and Interaction using Visual Markers. C. Kray and M. Rohs. (2007) In „Workshop on Mobile Interaction with the Real World at Mobile HCI 2007“. Singapore, September 9, 2007.

Visual aid for navigation – using human image processing

While browsing the equator website I came again across an interesting publication – I had seen two years ago at MobileHCI – in the domain of pedestrian navigation [1]. The Basic idea is to use a collection of geo-tagged photos to provide visual cues to people in what direction they should go, e.g. “walk towards this building”. This is an interesting application linking two concepts we discussed in the part on location in my lecture on pervasive computing. It follows the approach of augmenting the user in a way that the user does what he does well (e.g. matching visual images) and the computer what it does well (e.g. acquiring GPS location, finding pictures related to a location in a DB).

[1] Beeharee, A. K. and Steed, A. 2006. A natural wayfinding exploiting photos in pedestrian navigation systems. In Proceedings of the 8th Conference on Human-Computer interaction with Mobile Devices and Services (Helsinki, Finland, September 12 – 15, 2006). MobileHCI ’06, vol. 159. ACM, New York, NY, 81-88. DOI= http://doi.acm.org/10.1145/1152215.1152233

Keynote at Pervasive 2008: Mark Billinghurst

Mark Billinghurst presented an interesting history of augmented reality and he showed clearly that camera phones are the platform to look out for. He reminded us that currently the 3D performance of mobile phones is similar to the most powerful 3D graphics cards show 15 years ago at SIGGRAPH. Looking back at Steven Feiner’s backpack [1] – the first augmented reality system I saw – can tell us that we should not be afraid to create prototypes that may be a bit clumsy if they allow us to create a certain user experience and for exploring technology challenges.

In an example video Mark showed how they have integrated sensor information (using particle computers) into an augmented reality application. Especially for sensor-network applications this seems to create interesting user interface options.

One reference on to robust outdoor tracking done at Cambridge University [2] outlines interestingly how combining different methods (in this case GPS, inertial, computer vision and models) can move location techniques forward. This example shows that high precision tracking on mobile devices may not be far in the future. For our application led research this is motivating and should push us to be more daring with what we assume from future location systems.

Mark argue to look more for the value of experience – the idea is basically that selling a user experience is of higher value than selling a service or a technology. This view is at the moment quite common – we have seen this argument a lot at CHI2008, too. What I liked with Mark’s argument very much is that he sees it in a layered approach! Experience is at the top of a set of layers – but you cannot sell experience without having technology or services and it seems a lot of people forget this. In short – no experience design if you do not have a technology working. This is important to understand. He included an example of interactive advertisement (http://www.reactrix.com/) which is interesting as it relates to some of the work we do on interactive advertisement (there will more as soon as we have published our Mensch und Computer 2008 paper).

His further example on experience was why you value a coffee at Starbucks at 3€ (because of the overall experience) reminded me of a book I recently read – quite a good airline/park read (probably only if you are not an economist) – makes the world a bit understandable [3].
Build enabling technologies and toolkits as means to improve one’s citation count was one of Mark’s recommendations. Looking back at our own work as well as the work of the Pervasive/Ubicomp community there is a lot of room for improvement – but it is really hard to do it …

[1] S. Feiner, B. MacIntyre, T. Höllerer, and T. Webster, A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. Proc. ISWC ’97 (First IEEE Int. Symp. on Wearable Computers), October 13-14, 1997, Cambridge, MA. Also in Personal Technologies, 1(4), 1997, pp. 208-217, http://www1.cs.columbia.edu/graphics/publications/iswc97.pdf, http://www1.cs.columbia.edu/graphics/projects/mars/touring.html

[2] Reitmayr, G., and Drummond, T. 2006. Going out: Robust model-based tracking for outdoor augmented reality. In Proceedings of IEEE ISMAR’06, 109–118.http://mi.eng.cam.ac.uk/~gr281/docs/ReitmayrIsmar06GoingOut.pdf, http://mi.eng.cam.ac.uk/~gr281/outdoortracking.html

[3] Book: Tim Harford. The Undercover Economist. 2007. (German Version: Ökonomics: Warum die Reichen reich sind und die Armen arm und Sie nie einen günstigen Gebrauchtwagen bekommen. 2006.)

Mobile Physical Interaction in the Wild

The parking meter is some streets of Dublin are an interesting example of an interface following the basic idea of physical mobile interaction. As you see from the manual sticker – the first part is on the mobile phone: you call a number and then provide the place in which you are (by typing in a number). The second part is then on the ticket machine – till you get the print out. The amazing thing was I really saw people using it!

The user interface design is interesting as they use on the phone typical phone interaction (basically dialing an number) and keep the interaction with the ticket machine the same (except there is no need to insert coins) as it was before. But looking at some work we did in the PERCI project with DoCoMo in Munich we can tell that this is just the initial state of physical mobile interaction [1] – it can be expected that this will become more common!

[1] Broll, G., Siorpaes, S., Rukzio, E., Paolucci, M., Hamard, J., Wagner, M., and Schmidt, A. 2007. Supporting Mobile Service Usage through Physical Mobile Interaction. In Proceedings of the Fifth IEEE international Conference on Pervasive Computing and Communications (March 19 – 23, 2007). PERCOM. IEEE Computer Society, Washington, DC, 262-271. DOI= http://dx.doi.org/10.1109/PERCOM.2007.35

FacetZoom

Raimund Dachselt presented FaceZoom, a widget for quick navigation, e.g. for a tree structure [1]. I liked his characterizing “a stacked treemap” – which explains nicely what the widget does and where the efficency can be found. At TEI’08 he gave already a nice private demo on how this can be linked to mobile devices and how to use a off-the-shelf phone with an accelerometer as controller.

[1] Dachselt, R., Frisch, M., and Weiland, M. 2008. FacetZoom: a continuous multi-scale widget for navigating hierarchical metadata. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 – 10, 2008). CHI ’08. ACM, New York, NY, 1353-1356. DOI= http://doi.acm.org/10.1145/1357054.1357265

Paul presented a paper on mobile phone interaction at TEI’08

Paul Holleis presented at TEI’08 the results of the research he did during his internship at Nokia Research [1]. Over the summer Paul spent 3 month with Jonna Häkkila’s group in Helsinki, where he worked on two projects: combing touch and key-presses and wearable controls.

Technically both projects used capacitative sensing to recognize touch. In his paper “Studying Applications for Touch-Enabled Mobile Phone Keypads” [1] they added to common mobile phone buttons touch sensing so that multiple levels of interaction can be measured, such as approaching, touching and pressing. The paper additionally discusses new interaction possibility that arise from this.

[1] Paul Holleis, Jonna Häkkilä, Jussi Huhtala. Studying Applications for Touch-Enabled Mobile Phone Keypads. Proceedings of the 2nd Tangible and Embedded Interaction Conference TEI’08. February 2008.

Discussing project ideas at DoCoMo Euro-labs

When I was still in Munich we worked on the PERCI project together with DoCoMo Euro-lab. This collaboration was very fruitful, as all partners had a deep understanding what they are doing an where technically excellent.

After my moving we finally found some time again to discuss project ideas. There are many options in the mobile domain and we found some interesting topics related to advertising where their expertise and our expertise could create interesting synergies.

Breakfast at Google in Munich

Recently Frank Spychalski (a student from Karlsruhe University 1999) contacted me and told me that he is now with Google in Munich. As we were in Munich anyway we took the chance to meet (and as the schedule was already full breakfast was the only time slot left).

The office in Munich is close to Marienplatz, the very central spot in Munich. They are currently setting up an engineering team. It looks like a great place to work. Perhaps there may be options for some of our students to do an internship in the future.

The visit at Google reminded me of the android developer challenge. The deadline is beginning of March – perhaps there is still some time to motivate some students to create something interesting…

Personal mobile health – Nintendo GlucoBoy

Recently an interesting mobile health product was launched: the glucoboy – http://www.glucoboy.com/ . It is designed as an add-on to the Nintendo Gameboy. The basic idea is to combine blood glucose measuring for children and video gaming.

This product shows that an in-depth understanding of the problem domain can create novel interactive products (in this case the idea was conceived by a parent with a direct insight into the problem). For user interface engineering we see again a clear value of contextual enquiry (or at least contextual understanding) combined with a clever utilization of technology.

Just in time train schedule?

Thought experiment: if we have the same number of trains we have at the moment and we let them travel as we do at the moment – but without time tables (basically a train is always on time – it is there when it arrives – similar to today). Customers would have real time access to all trains and the system could provide estimates when a certain train is where – perhaps with a confidence interval and probabilities of connections and travel times (obviously with an understandable user interface).

Would this be a better or worse model of public transport?

… and by the way the coach I was in has the IP address 192.168.97.181 and runs DOS 😉