Context-Aware adverts, google patent search

This evening I went to Münster to meet with Antonio Krüger and Lucia Terrenghi (who is now with Vodafone), who was visiting there. Advertisement is a hot topic and it was interesting that we shared an interesting observation “If the advert/information is the least boring thing to look at people will read it ;-)”. Each of us having their favorite anecdotal evidence: my favorites are people reading the same map everyday at their U-station and the advertising flyers in the Munich S-Train. For context-aware advertisement this is the major challenge to find the time/location where people are bored and happy to see an advert 😉

We currently have an ongoing master thesis that looks into this topic – context-aware advertising with cars. There are several interesting examples that this concept could work: e.g. Taxis that show location based ads (you can hire your area where your ad is shown, see [1], [2]). We think it gets really interesting if there are many cars that form a in-town canvas you can paint on. On the way back we checked out the screen adverts (include in the public phones) Jörg Müller works on – even with a navigation feature.

Looking for some more on the topic I realized that Google Patent search works quite well by now: http://www.google.de/patents

Tutorial von Sensor to Context und Activity at Pervasive 2008

Pervasive 2007 introduced a new form of tutorials – having a number of experts talking one hour about their special topic – I was last year as participant and liked it a lot. This year Pervasive 2008 repeated this approach and I contributed a tutorial on how to get context and activity from sensors (tutorial slides in PDF).

Abstract. Intelligent environments, sensor network and smart objects are inherently connected to building systems that sense phenomena in the real world and make the perceived information available to applications. In the first part of the tutorial an overview of sensors and sensor systems commonly used in pervasive computing application is given. Additionally to the sensor properties means for connecting sensors to systems (e.g. ADC, PWM, I2C, serial line) are explained. In the second part it is discussed how to create meaningful information in the application domain. Some basic features, calculated in the time and frequency domain, are introduced to provide basic means for processing and abstraction of raw sensor data. This part is complemented by a brief overview of mechanisms and methods for relating (abstracted) sensor information to context, activity and situations. Additionally general problems that are associated with sensing context and activity will be addressed in this tutorial.

Have Not Changed Profession – Hospitals are complex

This morning we had the great opportunity to observe and discuss workflows and work practice in the operating area in the Elisabeth hospital in Essen. It was amazing how much time from (really busy) personnel we got and this provided us with many new insights.

The complexity of scheduling patients, operations, equipment and consumables in a very dynamic environment poses a great challenges and it was interesting to see how well it works with current technologies. However looking at the systems used and considering upcoming pervasive computing technologies a great potential for easing tasks and processes is apparent. Keeping tracking of things and people as well as well as documentation of actions are central areas that could benefit.

From a user interface perspective it is very clear that paper and phone communication play an important role, even in such high-tech environment. We should look a bit more into the Anoto Pen technology – perhaps this could be an enabler for some ideas we discussed. Several ideas that relate to implicit interaction and context awareness (already partly discussed in the context of a project in Munich [1]) re-surfaced. Similarly questions related to data access and search tools seem to play an interesting role. With all the need for documentation it is relevant to re-thing in what ways data is stored and when to analyses data (at storage time or at retrieval time).

One general message from such a visit is to appreciate people’s insight in these processes which clearly indicates that a user centered design process is the only suitable way to move innovation in such environments forward and create by this ownership and acceptance.

[1] A. Schmidt, F. Alt, D. Wilhelm, J. Niggemann, H. Feussner. Experimenting with ubiquitous computing technologies in productive environments. e & i Elektrotechnik und Informationstechnik, Springer Verlag. Volume 123, Number 4 / April, 2006. pages 135-139

Reminded of the Ubicomp Vision

Today I was reminded of a discussion in 1998 on the implications of computing technologies becoming cheaper and cheaper. Even then it seemed inevitable that many artifacts will include computational and perceptual qualities. The discussion was in the context of the European project TEA (technology for enabling awareness) where we built a context-aware phone [1]. Walter van de Velde suggested imagining that processors, sensors, communication will only cost cents (or will be virtually free as part of the production process) and we worked on the question: what products and services will emerge? One generic answer then was than any product of a value 20$ and above will include computing and sensing capabilities, if there is any (even a minimal) advantage achieved by this.

Michael Beigl made it more concrete and found coffee mugs (which were more than 20$ each) and attached a processor, communication and sensors. The MediaCup [2] showed several interesting results and underlined that such approach makes sense if there is an advantage.

Today I saw in an office of a former colleague in Munich two objects that had perceptual qualities and output (not really processing yet). One object is a plastic toad that makes a noise when you move and the other is a rubber pig that makes a noise when you open the fridge (reacts on change in level, but did not work). This made me wonder if we were only partially right – yes objects will have sensors included, yes there will be processing, but no there is no need that it makes sense. Or perhaps having it as a gadget is advantage enough…

[1] Schmidt, A., Aidoo, K. A., Takaluoma, A., Tuomela, U., Laerhoven, K. V., and Velde, W. V. 1999. Advanced Interaction in Context. In Proceedings of the 1st international Symposium on Handheld and Ubiquitous Computing (Karlsruhe, Germany, September 27 – 29, 1999). H. Gellersen, Ed. Lecture Notes In Computer Science, vol. 1707. Springer-Verlag, London, 89-101. DOI= http://dx.doi.org/10.1007/3-540-48157-5_10

[2] Gellersen, H. W., Schmidt, A., and Beigl, M. 2002. Multi-sensor context-awareness in mobile devices and smart artifacts. Mob. Netw. Appl. 7, 5 (Oct. 2002), 341-351. DOI= http://dx.doi.org/10.1023/A:1016587515822

UbiLog Workshop in Bremen

This afternoon our UbiLog workshop was held in Bremen as part of the Informatik 2007 conference. We selected 4 papers for presentation and had a lively and interesting discussion.

Following the talk of Nikolai Krambrock we discussed the use context, and in particular location, to restrict or allow access to information. My favourite example is an online-banking appliance that only works in predefined areas (e.g. at home and in my car). Using context appears one option in creating human understandable solutions for secure systems. People have developed means to protect physical objects and valuable, perhaps we should draw more on this experience in the design of secure systems.

Article in the Economist

Some weeks ago Ben Sutherland from The Economist called. He was researching for an article discussing the computing revolution over the last 25 years. In his research he to talked to many different people (from different countries, different fields, different views) and was particularly interested in applications that will come in the future and with me in particular on the concept of context-awareness.

The article „The trouble with computers“ appeared 6th of September and discusses a mix of ideas and viewpoints. We talked about 30 minutes on the phone and I am quite surprised what statement he picked from me (I said many things that were more interesting ;-). However I think it is great that people start trying to understanding the radical changes computers introduce – everywhere.

Automotive User Interface Workshop

At the German HCI conference (Mensch und Computer) I organized together with Paul Holleis and Klaus Bengler (BMW Group) a workshop on automotive user interfaces. We were surprised how many people work and research in this area in Germany and Austria.

The 9 talks showed a wide range of research results and questions ranging from activity recognition, search interfaces, cultural issues to research methods. Dagmar Kern presented our work on a new method for interviewing drivers at the gas station. Stefan Graf from BMW groups had an interesting demo on object oriented interaction and in-car text input.

In the final session we discussed on future challenges of automotive user interfaces and it seems that it is a great challenge as cars are very emotional products. One interesting point was that user interfaces may not be central for the decisions which car to buy – but if not satisfied it will influence the decisions not to buy such a car again.

Context and context-awareness (e.g. based on user activity, driving parameters and location) seems to provide a great opportunity for future interfaces and in-car applications. One nice example was presented by Susanne Boll from a joint project with VW (C3World, connected cars in a connected world).

Navigation by calories – New insights useful for next generation navigation systems?

In a German science news ticker I saw an article a inspiring post reporting an experiment on orientation in relation to food. It describes an experiment where men and women were asked to visit a set of market stalls to taste food and afterwards they are asked where the stall was.

The to me surprising result was that women performed better than men (which is to my knowledge not often the case in typical orientation experiments) and that independent of gender the amount of calories that are contained in the tasted food influenced the performance. Basically if there are more calories in the tasted food people could remember better where it was. I have had no change yet to read the original paper (Joshua New, Max M. Krasnow, Danielle Truxaw und Steven J.C. Gaulin. Spatial adaptations for plant foraging: women excel and calories count, August 2007, Royal society publishing, http://www.journals.royalsoc.ac.uk) and my assessment is only based on the post in the newsticker.

This makes me think about future navigation systems and in particular landmark based navigation. What landmarks are appropriate to use (e.g. places where you get rich food) and how much this is gender dependent (e.g. the route for men is explained by car-dealers and computer shops whereas for women by references to shoe shops – is this political correct?).

Apropos: landmark based navigation. There is an interesting short paper that was at last years UIST conference that looks into this issue in the context of personalized routes:
Patel, K., Chen, M. Y., Smith,
I., and Landay, J. A. 2006. Personalizing routes. In Proceedings of the 19th Annual ACM Symposium on User interface Software and Technology (Montreux, Switzerland, October 15 – 18, 2006). UIST ’06. ACM Press, New York, NY, 187-190. DOI= http://doi.acm.org/10.1145/1166253.1166282

Perhaps this ideas could be useful for a future navigation system…

Ubiquitous, Pervasive and Ambient Computing – Clarification of Terms

In the resent month the question about ubiquitous, pervasive, ambient computing came up several times. An email by Jos Van Esbroeck motivated me to write my view on it…

Clarifying the terms seems an ongoing process as various communities and individuals use each of those terms for new things they are doing.

For me the best way to discriminate the terms ubiquitous computing, pervasive computing, and ambient intelligence is by their origin, history and research communities.

The first term (ubiquitous computing, ubicomp) is linked to Mark Weiser and his vision of computing in the 21st century [1]. In the research community its is very much connected to ubiquitous and pervasive systems that have the user somewhere in the loop. The ubicomp conference [2] seems more focused on user experience than on pure technology.

Pervasive Computing was pushed in the mid 1990s, more by industry and in particular by IBM. Pervasive computing seems from its origin more focused on technologies and solutions than on a particular vision. The two major conferences related to this topic: pervasive [3] and percom [4] are more systems and network focused, however always keeping some attention to the user experience perspective. Here, in particular with percom, many in the research community have their origin in the networking and distributed systems world. To me pervasive computing seems more technical than ubiquitous computing and includes systems that do no have direct human users involved.

The term ambient intelligence was introduced by the European funding agencies in the Framework 5 vision. Around the same time as the Philips Home-lab that drives the term, too. Here, similar to ubicomp, the vision of a new quality of user experience is a driving factor. The research that falls under this label by now is broad and I think it is very similar to the research in ubiquious computing. There is also a European conference on ambient intelligence [5].

Many people that are involved in ubicomp/pervasive/percom are also active in one more traditional research community. In particular many people are additionally involved in user interface research (e.g. CHI-Community), mobile computing and mobile systems, networking and distributed systems.

A very early topic related to the whole field is context-awareness as introduced by Schilit [6] who was working with Weiser. In my PhD dissertation I have looked more into the relationship between ubicomp and context-awareness – it has the title Ubiquitous Computing – Computing in Context [7]

In parallel subtopic in the above field have emerged that look at specific aspects, e.g. internet of things [8] (not necessarily a human in the loop), wearable computing (computing in cloth), smart environments (computing in buildings and furniture), tangible and embedded interaction [9] (looking at the interaction side), smart objects, … and probably many more.

There is also an interesting trend that many of the topics, if they are a bit matured, move back into the traditional communities.

[1] Mark Weiser. The Computer for the Twenty-First Century. Scientific American 265, 3 (September 1991), 94-104
[2] http://www.ubicomp.org/
[3] http://pervasive2008.org/
[4] http://www.percom.org/
[5] http://www.ami-07.org/
[6] B. Schilit, N. Adams, and R. Want. (1994). „Context-aware computing applications„. IEEE Workshop on Mobile Computing Systems and Applications (WMCSA’94), Santa Cruz, CA, US: 89-101 .
[7] Albrecht Schmidt(2003). „Ubiquitous Computing – Computing in Context„. PhD dissertation, Lancaster Univeristy.
[8] http://
www.internetofthings-2008.org
[9] http://www.tei-conf.org/