Our Paper and Posters at Mobile HCI 2009

Ali presented our joint work with Nokia Rearch and DoCoMo Eurolab in the paper on sharing emotions [1] (the acceptance rate was about 20%). The research is motivated by the question how we can make communication more emotional and how we can enable digital craft creating. The idea is to have a new communication medium were a communication item is hand crafted and can carry emotion. The questions were encouraging and we hope to continue to work on this topic.

In the poster session we had two contributions. Christian Winkler showed his project on Flash-light interaction [2]. The idea is simple: a camera in the environment or screen tracks the flash light of the phone – but it is very effective.

Ali presented a poster on a new poker table; this is a project some of our students build last term. An interesting aspect is that the playing cards are on the phone, the table is a multitouch table, and interaction is based on gestures (on the table as well as with the phone).

Have look at the table of contents of the entire conference to get an overview of current work in mobile HCI.

[1] Shirazi, A. S., Alt, F., Schmidt, A., Sarjanoja, A., Hynninen, L., Häkkilä, J., and Holleis, P. 2009. Emotion sharing via self-composed melodies on mobile phones. In Proceedings of the 11th international Conference on Human-Computer interaction with Mobile Devices and Services (Bonn, Germany, September 15 – 18, 2009). MobileHCI ’09. ACM, New York, NY, 1-4. DOI= http://doi.acm.org/10.1145/1613858.1613897

[2] Alireza Sahami Shirazi, Christian Winkler, Albrecht Schmidt: Flashlight Interaction: A Study on Mobile Phone Interaction Techniques with Large Displays (Poster). In: Adjunct Proceedings of the 11th international Conference on Human-Computer interaction with Mobile Devices and Services (MobileHCI’09) – Poster. Bonn, Germany 2009.

[3] Alireza Sahami Shirazi, Tanja Döring, Pouyan Parvahan, Bernd Ahrens, Albrecht Schmidt: Poker Surface: Combining a Multi-Touch Table and Mobile Phones in Interactive Card Games (Poster).In: Adjunct Proceedings of the 11th international Conference on Human-Computer interaction with Mobile Devices and Services (MobileHCI’09) – Poster. Bonn, Germany 2009.

Ethics as material for innovation – German HCI conference – Mensch und Computer

On Tuesday I was at the German human computer interaction conference called Mensch und Computer. The keynote by Alex Kirlik was on Ethical Design (slides from his talk) and he showed how ethics extends beyond action to technology leading to the central question: Why should we build certain systems? His examples and the following discussion made me wonder whether „Ethics become the next Material for innovation“. Taking his example of 9/11 where old technology (air planes) and a different view on ethics was used to strike this is in contrast to previous/typical warfare where new technologies (e.g. Gun powder, Nuclear bomb) have changed the way wars are conducted.

Considering ethics as material for innovation is obviously risky but looking at successful businesses of the last decade such a trend can be argued for (e.g. google collecting information about the user to provide new services, youtube allowing users to share content with limited insurance that it is not copyrighted). Would be interesting to have a workshop on this topic sometime in the future…

Grace who left our group after finishing her Master’s degree (to work in the real world outside of university 😉 presented her paper on how to aid communication in the car between driver and passenger [1].

In the afternoon the working group on tangible interaction in mixed realities (in German Be-greifbare Interaktion in Gemischten Wirklichkeiten) had a workshop and a meeting. We will host the next workshop of the working group in Essen early next year (probably late February or early March).

PS: the next Mensch & Computer Conference ist at the University of Duisburg-Essen 🙂

[1] Grace Tai, Dagmar Kern, Albrecht Schmidt. Bridging the Communication Gap: A Driver-Passenger Video Link. Mensch und Computer 2009. Berlin.

Interact 2009, Never been to Uppsala

Uppsala in Sweden is still one of the places I have never been to – and this year I missed another chance: Interact 2009

From our group Florian was there an presented his paper on a parasitic applications for the web [1]. We also published joined work with ETH Zürich on a comparison of product identification techniques on mobile devices [2]. Heiko Drewes has submitted his PhD thesis on Eye-tracking for interaction and one of the early projects he did was now published at Interact. The idea is that the mouse courser is positioned to the position where your eye-gaze is in the moment you touch the mouse [3]. Interact 2009 was quite competetive as it had an acceptance rate of 29% for research papers.

[1] Alt, F., Schmidt, A. Atterer, R., Holleis, P. 2009. Bringing Web 2.0 to the Old Web: A Platform for Parasitic Applications. Human-Computer Interaction – INTERACT 2009. 12th IFIP TC 13 International Conference, Uppsala, Sweden, August 24-28, 2009. Springer LNCS 5726. pp 405-418.
http://www.springerlink.com/content/vr175l725m7185m6/

[2] von Reischach, F., Michahelles, F.,Guinard, D.,Adelmann, R. Fleisch, E., Schmidt, A. 2009. An Evaluation of Product Identification Techniques for Mobile Phones. Human-Computer Interaction – INTERACT 2009. 12th IFIP TC 13 International Conference, Uppsala, Sweden, August 24-28, 2009. Springer LNCS 5726. pp 804-816
http://www.springerlink.com/content/740421515527855g/

[3] Drewes, H., Schmidt, A. 2009. The MAGIC Touch: Combining MAGIC-Pointing with a Touch-Sensitive Mouse. 2009. Human-Computer Interaction – INTERACT 2009. 12th IFIP TC 13 International Conference, Uppsala, Sweden, August 24-28, 2009. Part II. Springer LNCS 5727. pp 415-428
http://www.springerlink.com/content/m188522m6q5470l2/

Our Publications at Pervasive – Public Displays, Car Adverts, and Tactile Output for Navigation

Our group was involved in 3 papers that are published at Pervasive 2009 in Nara.

The first contribution is a study on public display that was presented by Jörg Müller from Münster. The paper explores display blindness that can be observed in the real world (similarly to banner blindness) and concludes that the extent to which people look at displays is very much correlated to the users expectation of the content of a display in a certain location [1].

The second short paper is a survey on car advertising and has been conducted in the context of the master thesis of Christoph Evers. The central question is about the design space of dynamic advertising on cars and how the users perceive such a technology [2].

Dagmar presented a paper on vibra-tactile output integrated in the steering wheel for navigation systems in cars. The studies explored how multi-modal presentation of information impact driving performance and what modalities are preferred by users. The general conclusion is that combining visual information with vibra-tactile output is the best option and that people prefer multi-modal output over a single modality [3].

[1] Jörg Müller, Dennis Wilmsmann, Juliane Exeler, Markus Buzeck, Albrecht Schmidt, Tim Jay, Antonio Krüger. Display Blindness: The Effect of Expectations on Attention towards Digital Signage. 7th International Conference on Pervasive Computing 2009. Nara, Japan. Springer LNCS 5538, pp 1-8.
http://www.springerlink.com/content/gk307213786207g2

[2] Florian Alt, Christoph Evers, Albrecht Schmidt. User’s view on Context-Aware Car Advertisement. 7th International Conference on Pervasive Computing 2009. Nara, Japan. Springer LNCS 5538, pp 9-16.
http://www.springerlink.com/content/81q8818683315523

[3] Dagmar Kern, Paul Marshall, Eva Hornecker, Yvonne Rogers, Albrecht Schmidt. Enhancing Navigation Information with tactile Output Embedded into the Steering Wheel. 7th International Conference on Pervasive Computing 2009. Nara, Japan. Springer LNCS 5538, pp 42-58.
http://www.springerlink.com/content/x13j7547p8303113

Workshop on Pervasive Computing in Advertising

We got a good set of submission for our workshop and had about 20 participants who joined us in Nara to discuss how pervasive computing will shape advertising in the future. The papers and a selection of talks is online on the workshop website: http://pervasiveadvertising.org

One question that was central to our discussion was: what is advertising and how is it different from information. It became quickly clear that there is a lot of information that has an influence on behavior and in particular shopping decisions and some of it is considered advertising but much is not. Hence it seems really interesting to imagine a world where advertising is replaced by information. One could image that replacing advertising by information (e.g. as it happens already in some domains such a hotel recommendations) would change the whole approach for creating product or providing services.

We have presented in the workshop our work on contextual mobile displays. The idea is that in the future we could have mobile displays (that replace current printed items, like bumper stickers, bags with printed logos, and t-shirts with prints) could become active and could act as contextual displays. Have a look at the paper for more details [1].

[1] Florian Alt, Albrecht Schmidt, Christoph Evers. Mobile Contextual display system. Pervasive Advertising Workshop at Pervasive 2009. (contact Florian Alt for a copy of the paper)

Ranking Conferences and Journals – A Down-Under perspective

As many of us I am skeptical of rankings (as long as I was not involved in making them 😉 Nevertheless sometimes they are interesting and helpful in assessing where to publish or what better not to read…

This morning we discussed where to publish some interesting work related to web technology (a follow-up of the UsaProx) and for the discussion such a list may have been helpful. 
A colleague from Munich sent me the link to an Australian conference ranking and obviously they also have ranked Journals, too. They use A+, A, B, L, and C as tiers.
… and as we always knew you cannot be wrong when publishing in Pervasive, Percom, Ubicomp, and CHI 🙂

Our Posters at Ubicomp 2008

In the poster session we showed 3 ideas of ongoing work from our lab and got some interesting comments and had good discussions. 
Ali presented initial findings from our experiments with multi-tactile output on a mobile phone [1]. He created a prototype with 6 vibration motors that can be individually controlled. In the studies we looked at what locations of the vibration elements and what patters can be spotted by the user. In short it seems that putting the vibration motors in the corners works best.

Florian showed ideas on counting page impressions on public advertising screens we sketched out with Antonio’s Group in Münster [2]. The basic idea is to use sensors to get an idea of the number of people passing by. To calibrate such a system (as the sensor observations are only incomplete) we propose to use existing ways of counting people (e.g. access gates to public transport) and extrapolate based on this information.

I presented Dagmar’s poster on initial work on providing information on the fuel economy in an engaging way to the user [3]. In a focus group study we observed that people are more aware of the price of a journey when using public transport than when using a car. For the car they know well the price per liter but have to calculate the price for a typical trip (e.g. to work). We suggest ideas where one can compete with others (e.g. from the social network) in saving energy on a specific route.

[1] Alireza Sahami Shirazi, Paul Holleis, Albrecht Schmidt. Rich Tactile Output for Notification on Mobile Phones (2-page paper, poster). Adjunct proceedings of Ubicomp 2008, Seoul, Korea, p26-27
[2] Albrecht Schmidt, Florian Alt, Paul Holleis, Jörg Müller, Antonio Krüger. Creating Log Files and Click Streams for Advertisements in Physical Space (2-page paper, poster). Adjunct proceedings of Ubicomp 2008, Seoul, Korea, p28-29
[3] Dagmar Kern, Paul Holleis, Albrecht Schmidt. Reducing Fuel Consumption by Providing In-situ Feedback on the Impact of Current Driving Actions (2-page paper, poster), Adjunct proceedings of Ubicomp 2008, Seoul, Korea, p18-19

Workshop on Automobile User Interfaces

For the second time we ran this year a workshop on automobile user interfaces and interactive applications in the car at the German HCI conference: http://automotive.ubisys.org/

In the first session we discussed the use of tactile output and haptics in automotive user interfaces. It appears that there is significant interest in this area at the moment. In particular using haptics as an additional modality creates a lot of opportunities for new interfaces. We had a short discussion about two directions in haptic output: naturalistic haptic output (e.g. line assist that feels like going over the side of the road) vs. generic haptic output (e.g. giving a vibration cue when to turn).

 I think the first domain could make an interesting project – how does it naturally feel to drive too fast, to turn the wrong way, to be too close to the car in front of you, etc…

In a further session we discussed framework and concepts for in-car user interfaces. The discussion on the use of context with the interface was very diverse. Some people argued it should be only used in non-critical/optional parts of the UI (e.g. entertainment) as one is not 100% sure if the recognized context is right. Others argue that context may provide a central advantage, especially in safety critical systems, as it gives the opportunity to react faster. 

In the end it comes always down to the question: to what extent do we want to have the human in the loop… But looking at Wolfgang’s overview slide it is impressive how much functionality depends already now on context…

In the third session we discussed tools and methods for developing and evaluating user interfaces in the car context. Dagmar presented our first version of CARS (a simple driving simulator for evaluation of UIs) and discussed findings from initial studies [1]. The simulator is based on the JMonkey Game engine and available open source on our website [2].

There were several interesting ideas on what topics are really hot in automotive UIs, ranging from interfaces for information gather in Car-2-Car / Car-2-Envrionment communication to micro-entertainment while driving.

[1] Dagmar Kern, Marco Müller, Stefan Schneegaß, Lukasz Wolejko-Wolejszo, Albrecht Schmidt. CARS – Configurable Automotive Research Simulator. Automotive User Interfaces and Interactive Applications – AUIIA 08. Workshop at Mensch und Computer 2008 Lübeck 2008

[2] https://www.pcuie.uni-due.de/projectwiki/index.php/CARS

PS: In a taxi in Amsterdam the driver had a DVD running while driving – and I am sure this is not a form of entertainment that works well (it is neither fun to watch, nor is it save or legal).

We presented MirrorBoard at Mensch und Computer 2008 in Lübeck

Last winter term I was teaching a class on Unconventional User Interfaces at the University of Linz as part of the MSc in Pervasive Computing. As part of the exercises the students had to do a project and write a paper on the topic in a group. This required to do a full round in the development (from idea creation to study).

Florian König and his group had an exciting idea for a novel form of advertisement. The user is mirrored in the advert and becomes a part of it. They implemented an interactive poster for a travel agent (users become part of the holyday scene) and tested it in-situ. The paper was accepted at the German HCI conference (Mensch und Computer) and Florian presented it today very well [1].

In the questions there was much discussion about privacy and user acceptance. We discussed whether or not such a installation would be legal in Germany (people mentioned the Datenschutzgesetz §6).

[1] Johannes Schönböck, Florian König, Gabriele Kotsis, Dominik Gruber, Emre Zaim, Albrecht Schmidt. MirrorBoard – An Interactive Billboard. Mensch und Computer 2008. Lübeck. Oldenbourg Verlag, 2008, p 207-216.