Keynote by Pertti Huuskonen: Ten Views to Context Awareness

Pertti Huuskonen from Nokia presented his keynote at Percom in Mannheim. I worked with Pertti in 1999 on a European Project TEA – creating context-aware phones [1].

After telling us about CERN and some achievements in physics he raised the issue that an essential skill of humans is that they are context-aware. Basically culture is context-awareness – learning how to appropriately behave in life is essential to be accepted. We do this by looking at other people and by learning how how they act and how others react. „Knowing how to behave“ we become fit for social life and this questions the notion of intuitive use as it seems that most of it is learned or copied from others.

He gave a nice overview of how we can context-awareness is useful. One very simple example he showed is that people typically create context at the start of a phone call.

One example of a future to come may be ubiquitous spam – where context may be the enabler but also the enabler for blogging adverts. He also showed the potential of context in the large, see Nokoscope. His keynote was refreshing – and as clearly visible he has a good sense of humor 😉

[1] Schmidt, A., Aidoo, K. A., Takaluoma, A., Tuomela, U., Laerhoven, K. V., and Velde, W. V. 1999. Advanced Interaction in Context. In Proceedings of the 1st international Symposium on Handheld and Ubiquitous Computing (Karlsruhe, Germany, September 27 – 29, 1999). H. Gellersen, Ed. Lecture Notes In Computer Science, vol. 1707. Springer-Verlag, London, 89-101.

Opening of Percom, Keynote by Kurt Rothermel

About 300 people are at Percom 2010, which is held in the palace in Mannheim – and amazing location! The conference had 233 submission and is truly international (1/3 of the papers come from Europe, 1/3 from America, and 1/3 from Asia/pacific) and highly competitive (acceptance rate of about 12%).

Kurt Rothermel from the University of Stuttgart presented the opening Keynote on Large-scale Context Management. He presented a set of interesting example from Nexus (Collaborative Research Center 627, Spatial World Models for Mobile Context-Aware Applications) that showed the challenge in large scale systems. The size of the problem is can be easily seen when considering that half the population of the planet is using a mobile device and hence needs to be located… Now imagine everyone is contributing sensor data at a rate of one update per minute… For more details on their work see their 2009 percom paper [1]. In his talk he gave also some references to other interesting research platforms in this space: SensorWeb/SensorMap by Microsoft [2] and SensorPlanet by Nokia [3].

[1] Lange, R., Cipriani, N., Geiger, L., Grossmann, M., Weinschrott, H., Brodt, A., Wieland, M., Rizou, S., and Rothermel, K. 2009. Making the World Wide Space happen: New challenges for the Nexus context platform. In Proceedings of the 2009 IEEE international Conference on Pervasive Computing and Communications (March 09 – 13, 2009). PERCOM. IEEE Computer Society, Washington, DC, 1-4. DOI= http://dx.doi.org/10.1109/PERCOM.2009.4912782

[2] Kansal, A., Nath, S., Liu, J., and Zhao, F. 2007. SenseWeb: An Infrastructure for Shared Sensing. IEEE MultiMedia 14, 4 (Oct. 2007), 8-13. DOI= http://dx.doi.org/10.1109/MMUL.2007.82

[3] Abdelzaher, T., Anokwa, Y., Boda, P., Burke, J., Estrin, D., Guibas, L., Kansal, A., Madden, S., and Reich, J. 2007. Mobiscopes for Human Spaces. IEEE Pervasive Computing 6, 2 (Apr. 2007), 20-29. DOI= http://dx.doi.org/10.1109/MPRV.2007.38

Keynote by Frits Grotenhuis at AMI-2009

In the opening keynote of AMI 2009 Frits Grotenhuis (who stepped in for Emil Aarts) looked back at the last 10 years ambient intelligence. In his talk he showed a number of examples of devices that Philips created in this time, including iCat, the Entertaible, Ambilight, and medical devices. He discussed briefly the forces in such developments between market-pull and technology-push and it became evident that many products in this domain are more technology push than market-pull.

I liked the reference back to the Electronic Poem at the 1958 Brussels World’s Fair, which must have been at that time an amazing large scale installation (creating „surround sound“ with more than 200 speakers).

The update of the vision (title of the keynote was Ambient Intelligence 2.0: Towards Synergetic Prosperity) suggests a model where the human is in the center and the surrounded by the Mind (well being), Community (participation), Body (health), and Environment (responsibility). I found this did not offer many new insights as by now the human centered approach is widely accepted. Looking at the examples it seems that the vision is very much centering on the „rich“ world’s problem… perhaps it is really hard to update a vision.

Keynote at Automotive UI 2009: Gert Hildebrand, MINI/BMW

Tom Seder and I openend the conference and welcomed our keynote speaker.

I was very excited that Gert Volker Hildebrand accepted to be the keynote speaker for the 1st International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI 2009). He is with BMW Group in Munich and is the director of design for MINI. The topic of his talks was: „MINI Design: From the Original to the Original. The path from Center Speedo to Center Globe“. When I first came across the UI concept I wanted to meet the person – and a keynote is always one way 😉

I introduced the keynote with pictures from the Italian Job Movies (the first from 1969 and the second from 2003) and I find it impressive that the re-design inspired people to redo the movie.
In his talk he explained the design language used in the MINI- in short everything is a circles or a derivatives of circles. The concept of the center globe is a central sphere display that uses layers to include information. It has a horizontal surface (like a stage) and a background as well as a foreground.

The concept separates the UI for the driver (e.g. she gets navigation) and the passenger (she gets a access to the Internet). Search on Google or Bing for Mini Center-Globe and you get the idea. The concept uses a physical object (a sphere again) to transport content and to grand access – this reminded me of Durrell Bishop’s marble answering machine… Tangible UIs again 🙂

Gert Hildebrand also recommended his book „Mini Design“ by Othmar Wickenheiser and Gert Hildebrand. The books contains many design sketches and is partly English and partly German (only available at Amazon in Germany).

Overall the presentation showed again that likeability and aesthetics play an essential role in creating an attractive product – and especially an interactive product. Opening Automotive UI 2009 I made an analogy to mobile phones in 1998. Phones were then closed systems, UIs were very basic and it was very hard for 3rd parties to create applications. And now – 10 years later – UI and applications seem to play a more important role than the core technologies (or why would in 2007 people think a phone with a 2 Megapixel and without video recording and no UMTS is great).

Closing Keynote by Kentoaro Toyama at MobileHCI

Kentaro Toyama presented the closing keynote of MobileHCI 2009 with the title „Technology for Global Socio-Economic Development“. He gave an experience report of projects he works on in India. I liked especially that he included things that work but also discussed a set of myth with regard to ICT in the developing world (see Myths of ICT4D).

It is worthwhile to read more about his work, see Kentaro’s home page for more.

Mobile HCI 2009 Keynote by Jun Rekimoto

The opening keynote of MobileHCI 2009 in Bonn was given by Jun Rekimoto. He showed selected work that he did over the last year and showed that some of the far out concepts (from a few years ago) are becoming products now – augmented reality with playing cards as one example and WIFI based location using placeEngine.

Context also featured in his talk: but there was little new in it – still where when why who what how. He suggested the notion of sensonomy (as folksonomy – just for sensor information). I can see the value of share sensor information but the concept sensonomy remains fuzzy – at least for me. Perhaps we hear more about this in the future.

In the final part of the talk he moved to life-logging – but not for humans but for cats (or pets in more general). I think the work is interesting and he clearly showed that this is enterainment computing (not entertainment for the cat – for the human). Pets are an interesting area: they are still a major form of entertainment and people are willing to spend a lot on it…

Ethics as material for innovation – German HCI conference – Mensch und Computer

On Tuesday I was at the German human computer interaction conference called Mensch und Computer. The keynote by Alex Kirlik was on Ethical Design (slides from his talk) and he showed how ethics extends beyond action to technology leading to the central question: Why should we build certain systems? His examples and the following discussion made me wonder whether „Ethics become the next Material for innovation“. Taking his example of 9/11 where old technology (air planes) and a different view on ethics was used to strike this is in contrast to previous/typical warfare where new technologies (e.g. Gun powder, Nuclear bomb) have changed the way wars are conducted.

Considering ethics as material for innovation is obviously risky but looking at successful businesses of the last decade such a trend can be argued for (e.g. google collecting information about the user to provide new services, youtube allowing users to share content with limited insurance that it is not copyrighted). Would be interesting to have a workshop on this topic sometime in the future…

Grace who left our group after finishing her Master’s degree (to work in the real world outside of university 😉 presented her paper on how to aid communication in the car between driver and passenger [1].

In the afternoon the working group on tangible interaction in mixed realities (in German Be-greifbare Interaktion in Gemischten Wirklichkeiten) had a workshop and a meeting. We will host the next workshop of the working group in Essen early next year (probably late February or early March).

PS: the next Mensch & Computer Conference ist at the University of Duisburg-Essen 🙂

[1] Grace Tai, Dagmar Kern, Albrecht Schmidt. Bridging the Communication Gap: A Driver-Passenger Video Link. Mensch und Computer 2009. Berlin.

Keynote at Pervasive 2009 – Toshio Iwai

Toshio Iwai gave the keynote at Pervasive 2009 on expanding media art. He introduced us to the basics of moving images and films. The examples were fun and I think I will copy some for my introductory class on user interfaces for explaining the visual system (afterimages with a black-and-white negative image; the concept of combining images on two sides of a disk; the idea of moving images by using a flip book).

In his introduction he also went back to explain what he learned as a child and I found this very interesting and encouraging to expose smaller children more to technology than we usually tend to do (especially in Germany I think we do not give children much chance to explore technologies while they are in kindergarten and primary school). Hope to go with Vivien to the space center in Florida in few weeks 🙂

Following up from the basic visual effects he showed some really funny life video effects. He introduced a delay to some parts (lines) in the picture when displaying which led to ghostly movements. Everything that is not moving appears in its real shape and everything that is in motion will be deformed.

In the final part of his talk he argued that the Theremin is the only electronic instrument that has been newly invented in the 20th century. For him an instrument has to have unique interaction, unique shape, and unique sound. Additional for the interaction it is essential that the interaction can be perceived by the audience (you can see how one plays a violin but not how one makes digital music with a laptop computer). Based on this he show a new musical instrument he developed that is inspired by a music box. The instrument is the TENORI-ON [1]. It has a surface with 16×16 switches (that include an LED) and 16×16 LEDs on the back. It has a unique interaction, its shape and sound is unique and it supports visibility of interaction as the sound is combined with light pattern. The basic idea is that the horizontal direction is the time line and the vertical the pitch (similar to a music box).

[1] Yu Nishibori, Toshio Iwai. TENORI-ON. Proceedings of the 2006 International Conference on New Interfaces for Musical Expression (NIME06), Paris, France. http://www.nime.org/2006/proc/nime2006_172.pdf

Bob Iannucci from Nokia presents Keynote at HotMobile 2009

Bob Iannucci from Nokia presented his keynote „ubiquitous structured data: the cloud as a semantic platform“ at HotMobile 2009 in Santa Cruz. He started out with the statement that „Mobility is at the beginning“ and he argued that why mobile systems will get more and more important.

He presented several principles for mobile devices/systems

  • Simplicity and fitness for purpose are more important than feature
  • use concepts must remain constant – as few concepts as possible
  • presentations (what we see) and input modalities will evolve
  • standards will push the markets

Hearing this, especially the first point, from someone from Nokia seemed very interesting. His observations are in general well founded – especially the argument for simple usage models and sensible conceptual models when targeting the whole population of the earth as users.

In the keynote he offered an alternative conceptual model: Humans are Relational. Model everything as relations between people, things and places. He moved on to the question what are the central shortcomings in current mobile systems/mobile phones and he suggested it comes down to (1) no common data structure and (2) no common interaction concept.

With regard to interaction concepts he argued that a Noun-Verb style interaction is natural and easy for people to understand (have heard this before, for a discussion about it in [1, p59]). The basic idea in this mode is to choose a noun (e.g. people, place, thing) and then decide what to do with it (verb). From his point of view this interaction concept fits well the mobile device world. He argued that a social graph (basically relationships as in facebook etc.) would be well suited for a noun-verb style interaction. The nodes in the graph (e.g. people, photos, locations, etc.) are nouns and transformations (actions) between the nodes are the verbs. He suggested if we represent all the information that people have now in the phone as a graph and we have an open standard (and infrastructure) to share we could create a universal platform for mobile computing. (and potentially a huge graph with all the information in the world 😉

I liked his brief comment on privacy: „many privacy problems can be reduced to economic problems“. Basically people give their information away if there is value. And personally I think in most cases people give it away even for a minimal value… So far we have no market place where people can sell their information. He mentioned the example of a personal travel data which can provide the basis for traffic information (if aggregated). I think this is an interesting direction – how much value would have my motion pattern have?

Somehow related to what you can do on a mobile phone he shared with us the notion of the „3-Watt limit“. This seems fundamental: you cannot have more than 3 Watt used up in a device that fits in your hand (typical phone size) as otherwise it would get to hot. So the processing power limitation is not on the battery, but on the heat generated.

[1] Jef Raskin. The Humane Interface. Addison-Wesley. 2000.

Keynote at Ubicomp 2008, Dr. Shim Yoon

The opening keynote at Ubicomp 2008 was presented by Dr. Shim Yoon (Vice President Samsung SDS) on Realizing Ubiquitous Cities. She stated out with a few  scenarios of life in the future. Information is embedded into the environment – just in place and just in time – just what you need. Environments become pleasant and technologies look nice, so you can mistake a power distribution box for a sculpture. Cities will be really save as monitoring will be ubiquitous and continuous. Much of the vision is convincing and convenient (given that you have given up on privacy, too). 
There has been an interesting slide in the scenarios that  made me smile (in short „22:47, pick up the book reserved in advance for lending after taking a walk“). It basically says we will still have pretty long days and books will be around, too. 

I think in the age of ebooks I will not pick up books late in the evening. Looking at the analogies of previous technical revolutions one can argue that these reduced the number of hours people had to work to have a good life – it seems this technical revolution creates the opposite (u-work everywhere and anytime 😉 – is fine with me because I like my work :-)She described how technologies changes the urban culture, e.g. provision of water, later roads and harbors, and very recent fiber optics and mobile communications. In her view ubiquitous technologies will add a further paradigm shift. 

The overall concept of u-city can be condensed to her statement:  „u-city can solve complicated urban problems“ and this is attempted by combining political, physical and techno solutions. It is envisioned having IT included in all city elements. The approach follows a layered design with a base layer of the communication infrastructure (e.g. fixed and wireless infrastructure). In the middle there are the u-facility arrangements (e.g. sensor network, CCTV, power distribution), and on top u-services (u-home, u-office, u-traffic, …) are provided. 


It is envisioned that u-services are partly free (provided by the government) and partly
 commercial. Some of the examples for services see straight forward and very close (e.g. u-urban facility management that allows to monitor, check, maintain the infrastructure) and some are somehow scary (e.g. u-safety and security allows complete monitoring over the while city, ranging from fire recognition to behavioral analysis of its inhabitants). She pointed out that u-service modeling needs to include technical aspects as well as a business analysis.
The importance Korea sees in this topic is amazing and is summarized by the following quote „U-city is a key aspect in the next generation industry and economy in Korea“. The Korean government is behind the developments and urban planning embraces the concept and puts it at the center of the planning. Looking at the u-urban information concept it becomes apparent that this concept is valuable along the entire lifecycle, including planning, simulation, management and operation. One catch is that it has to be integrated while building, otherwise it will be expensive and it is not possible to gain the full potential. This is the bad message for most developed countries as we usually change our cities and do not build them from scratch…

Explaining more on the realization of u-city she argued that a new process is required and that construction and IT processes have  to go together. During city planning a u-city consulting process is performed (creating an IT master plan for the new city including the envisioning of the services). In the building process the IT-infrastructure is included (when it is easiest to realize). Running and managing the city includes operating U-city (basically running the IT services by a specific UbiCenter – a control center for the city).

In the final part of her keynote she talked a little about the Samsung U-City strategy. Here she saw a necessity to merge the city construction with the provision of IT capabilities. This ranges from  developing convergence Services (e.g. ubiquitous communication service, city control an & security services) to the creation of comprehensive services for complex housing environments. An example of a infrastructure device she mentioned is a complex lighting pole (which could include information display, LED lighting, CCTV camera, wireless access points, etc.). In summary the strategy is the development (and potentially the export) of world class u-city technologies. 
In the question session I raised the issue if this may lead to even more people moving from the rural areas to cities because of the new qualities such u-cities will provide. And it seems there will be even a greater difference between rural areas and cities in the future and this may strengthen the trend towards mega-cities. Perhaps we should think a bit more about u-rural…