Reminded of the Ubicomp Vision

Today I was reminded of a discussion in 1998 on the implications of computing technologies becoming cheaper and cheaper. Even then it seemed inevitable that many artifacts will include computational and perceptual qualities. The discussion was in the context of the European project TEA (technology for enabling awareness) where we built a context-aware phone [1]. Walter van de Velde suggested imagining that processors, sensors, communication will only cost cents (or will be virtually free as part of the production process) and we worked on the question: what products and services will emerge? One generic answer then was than any product of a value 20$ and above will include computing and sensing capabilities, if there is any (even a minimal) advantage achieved by this.

Michael Beigl made it more concrete and found coffee mugs (which were more than 20$ each) and attached a processor, communication and sensors. The MediaCup [2] showed several interesting results and underlined that such approach makes sense if there is an advantage.

Today I saw in an office of a former colleague in Munich two objects that had perceptual qualities and output (not really processing yet). One object is a plastic toad that makes a noise when you move and the other is a rubber pig that makes a noise when you open the fridge (reacts on change in level, but did not work). This made me wonder if we were only partially right – yes objects will have sensors included, yes there will be processing, but no there is no need that it makes sense. Or perhaps having it as a gadget is advantage enough…

[1] Schmidt, A., Aidoo, K. A., Takaluoma, A., Tuomela, U., Laerhoven, K. V., and Velde, W. V. 1999. Advanced Interaction in Context. In Proceedings of the 1st international Symposium on Handheld and Ubiquitous Computing (Karlsruhe, Germany, September 27 – 29, 1999). H. Gellersen, Ed. Lecture Notes In Computer Science, vol. 1707. Springer-Verlag, London, 89-101. DOI= http://dx.doi.org/10.1007/3-540-48157-5_10

[2] Gellersen, H. W., Schmidt, A., and Beigl, M. 2002. Multi-sensor context-awareness in mobile devices and smart artifacts. Mob. Netw. Appl. 7, 5 (Oct. 2002), 341-351. DOI= http://dx.doi.org/10.1023/A:1016587515822

Talk at the expert meeting on RFID and ubicomp

In Frankfurt there was today an expert meeting on RFID and ubicomp organized by the Fraunhofer ISI. The purpose was a discussion about the impact of RFID technologies. The organizers will use our input to inform the creation of a document of technology assessment for the German parliament. The majority of the participants came from companies developing RFID technology or system.
In the first part of my talk “RFID and Beyond” I highlighted results from two workshops where I was a co-organizer: PTA2006 and Pertec2007 held at the Pervasive and Percom conferences. The results were also published in 2 papers in the IEEE Pervasive Computing magazine, see [1] and [2]. After this I showed some future visions and scenarios, namely the Smart-Its & MediaCup (foto from Birgit at Teco) [3], the SensorKnife [4], and the aware goods project [5]. Michael Müller extended the idea of the first aware goods project with a mobile phone based prototype – which we still have not written up for publication.

For me the technology assessment in Germany seems still often very much centred on threats and looks much less at opportunities. Looking at developments in Asia and in particular in Korea (e.g. U-City) I hope politics in Germany will in the future more often see the positive sides, too. Technology assessment can become a means to find opportunities and ideas to support innovation. For me it seems that a lot of the risks people attribute to RFID are not based on scientific results – is appears rather media induced… Positive cases such as wireless key systems and transport tickets (basically RFID technology) are in widespread use without much problems and great value for users – but not present in the public discussion.

One interesting estimated was that about 200 parts of the several thousands (e.g. safety related parts, large parts, parts that are often stolen, expensive parts) per car will tagged with RFID in the next 10 years to ease logistics, production and maintenance.

[1] Schmidt, A.; Spiekermann, S.; Gershman, A.; Michahelles, F., „Real-World Challenges of Pervasive Computing„, Pervasive Computing, IEEE , vol.5, no.3pp. 91- 93, c3, July-Sept. 2006.

[2] Michahelles, F.; Thiesse, F.; Schmidt, A.; Williams, J. R.: Pervasive RFID and Near Field Communication Technology. In: IEEE Pervasive Computing, vol. 6, no. 3, pp. 94-96, c3, Jul., 2007.

[3] Hans-Werner Gellersen, Albrecht Schmidt, Michael Beigl: Multi-Sensor Context-Awareness in Mobile Devices and Smart Artifacts. MONET 7(5): 341-351 (2002)

[4] Matthias Kranz, Albrecht Schmidt, Alexis Maldonado, Radu Bogdan Rusu, Michael Beetz, Benedikt Hörnler, Gerhard Rigoll: Context-aware kitchen utilities. Tangible and Embedded Interaction 2007: 213-214

[5] Anke Thede, Albrecht Schmidt, Christian Merz: Integration of Goods Delivery Supervision into E-commerce Supply Chain. WELCOM 2001: 206-218

Interactive Mirrors – an upcoming topic beyond the idea?

At the CHI PC-meeting in Amsterdam I talked to a number of people – and it seems we are not the only one’s who are interested in interactive mirrors. It seems that breaking the physical limitations in time and space, a convention mirror imposes, creates some interest within the research community.

I talked to Boris de Ruyter about the Philips mirror project in the homelab and learned from Bo Begole about their work on interactive mirrors at PARC. It may be interesting to propose a workshop on interactive mirrors at one of the upcoming conference to get the people together looking into this topic.
In the hotel in Schiphol there was a mirror display for adverts. It did not really link any functionality of the mirror with the display, but nevertheless it was a aesthetically pleasing installation

Talk at the opening of the Fraunhofer IAO interaction lab

The Fraunhofer institute IAO opened today a new interaction lab in Stuttgart under the topic interaction with all senses. Prof. Spath, director of the Fraunhofer IAO, made a strong argument for new user interfaces. In his talk he discussed adaptive cruse control in cars as an example for user interface challenges.

My talk on “implicit interaction – smart living in smart environments” argues for a sensible mix of user centred design and technology driven innovation. As one example I used the Sensor-Knife which Matthias Kranz implemented.

Prof. Jürgen Ziegler, a colleague at the University of Duisburg-Essen who was previously at IAO, showed in his talk a short video of a “galvanic vestibular stimulation” GVS explored by NTT (SIGGRAPH 2005 Demo) to highlight trends and indicate at the same time ethical problems that can arise when we interfere with human senses.

Ubicomp 2007

Over the last few days at Ubicomp 2007 in Innsbruck it was great to catch up with many people from the community. The discussions in the evenings are very inspiring and so were some of the talks.

We tried to explain the idea of ubiquitous computing to journalist and it seems they got the idea. And hence Ubicomp 2007 was featured in the Austrian Press:

Ubicomp 2008 will be in Korea.

CardioViz Demo at Ubicomp 2007

Alireza Sahami presented our CardiViz project at the demo session at Ubicomp. We were very happy that the project that was the result of our IPEC course on developing mobile applications was accepted as a demo.

For more details see:
Alireza Sahami Shirazi, Diana Cheng, Oliver Kroell, Dagmar Kern, Albrecht Schmidt. CardioViz: Contextual Capture and Visualization for Long-term ECG Data. Adjunct Proceedings of Ubicomp 2007 (Demo).

Jonna Häkkilä, Anind Dey, Kari Hjelt, and I organized organized the Ubiwell workshop (Interaction with Ubiquitous Wellness and Healthcare Applications) at this years pervasive. Alireza presented another paper on heartbeat monitoring there:
Florian Alt, Alireza Sahami Shirazi, Albrecht Schmidt. Monitoring Heartbeat per Day to Motivate Increasing Physical Activity. UbiWell workshop@Ubicomp 2007.

Ubiquitous, Pervasive and Ambient Computing – Clarification of Terms

In the resent month the question about ubiquitous, pervasive, ambient computing came up several times. An email by Jos Van Esbroeck motivated me to write my view on it…

Clarifying the terms seems an ongoing process as various communities and individuals use each of those terms for new things they are doing.

For me the best way to discriminate the terms ubiquitous computing, pervasive computing, and ambient intelligence is by their origin, history and research communities.

The first term (ubiquitous computing, ubicomp) is linked to Mark Weiser and his vision of computing in the 21st century [1]. In the research community its is very much connected to ubiquitous and pervasive systems that have the user somewhere in the loop. The ubicomp conference [2] seems more focused on user experience than on pure technology.

Pervasive Computing was pushed in the mid 1990s, more by industry and in particular by IBM. Pervasive computing seems from its origin more focused on technologies and solutions than on a particular vision. The two major conferences related to this topic: pervasive [3] and percom [4] are more systems and network focused, however always keeping some attention to the user experience perspective. Here, in particular with percom, many in the research community have their origin in the networking and distributed systems world. To me pervasive computing seems more technical than ubiquitous computing and includes systems that do no have direct human users involved.

The term ambient intelligence was introduced by the European funding agencies in the Framework 5 vision. Around the same time as the Philips Home-lab that drives the term, too. Here, similar to ubicomp, the vision of a new quality of user experience is a driving factor. The research that falls under this label by now is broad and I think it is very similar to the research in ubiquious computing. There is also a European conference on ambient intelligence [5].

Many people that are involved in ubicomp/pervasive/percom are also active in one more traditional research community. In particular many people are additionally involved in user interface research (e.g. CHI-Community), mobile computing and mobile systems, networking and distributed systems.

A very early topic related to the whole field is context-awareness as introduced by Schilit [6] who was working with Weiser. In my PhD dissertation I have looked more into the relationship between ubicomp and context-awareness – it has the title Ubiquitous Computing – Computing in Context [7]

In parallel subtopic in the above field have emerged that look at specific aspects, e.g. internet of things [8] (not necessarily a human in the loop), wearable computing (computing in cloth), smart environments (computing in buildings and furniture), tangible and embedded interaction [9] (looking at the interaction side), smart objects, … and probably many more.

There is also an interesting trend that many of the topics, if they are a bit matured, move back into the traditional communities.

[1] Mark Weiser. The Computer for the Twenty-First Century. Scientific American 265, 3 (September 1991), 94-104
[2] http://www.ubicomp.org/
[3] http://pervasive2008.org/
[4] http://www.percom.org/
[5] http://www.ami-07.org/
[6] B. Schilit, N. Adams, and R. Want. (1994). „Context-aware computing applications„. IEEE Workshop on Mobile Computing Systems and Applications (WMCSA’94), Santa Cruz, CA, US: 89-101 .
[7] Albrecht Schmidt(2003). „Ubiquitous Computing – Computing in Context„. PhD dissertation, Lancaster Univeristy.
[8] http://
www.internetofthings-2008.org
[9] http://www.tei-conf.org/

Wall-Sized Printed Adverts with Integrated Screen

At Zurich Airport Orange and Nokia are running a large printed advert. At a first glance it looks just as a printed large scale poster. The TV screen in one poster and the projected writing on top of another poster are seamlessly integrated. The media design of the overall installation is appealing.

The active screen (could be a 50 inch plasma TV) is the screen of the mobile phone and shows the navigation application. In contrast to most other installations, where screens and printed posters are used, this appears right and it catches people’s attention.

There is work from Scott Klemmer’s group at Stanford that looks the relationship between the printed displays and projection/displays for various applications. The Gigaprints project was shown as a video at Ubicomp 2006.

Large scale sensor network connected to public displays

The airport Köln-Bonn (CGN) has all the parking spaces monitored with a simple sensor (detects if there is a car or not) and provides displays at the entrance showing the number of open spaces and has active signage in the parking garage leading to the free spaces – additionally it is visualized above each space – probably more a maintenance functions to see if the sensor works.

(looking at the pictures I have probably parked on women-only parking spots…)

Public Displays – Making Life More Predictable

On my way home from Toronto it was surprising how many public displays I saw that provided me with ”information about the future”, e.g. telling me when I will be out of time to cross the road, when the next train is due or when my luggage will arrive. These kinds of predictions or contexts are simple to gather and easy to present and best of all: the human is in control and can act on the information. Overall it is reassuring even if the context information is wrong (this is another story about my luggage ;-).