Pervasive Computing and Ethics

Together with Boriana Koleva I organized the doctoral colloquium at Pervasive 2007 in Toronto. We had 9 students presenting and discussing their PhD work with us.

One central observation was that we come to a point where we have to make more and more ethical decisions. Many things that are technical feasible and harmless within the lab may have sincere implications in the real world. If technologies for tracking, tracing and mining (e.g. social network analysis, location based services, context-aware systems) are deployed beyond the lab the question of choice becomes a real issue – are users aware of it and can they opt-out?

In the area of context-awareness technology has moved on since I started my PhD on the topic nearly 10 years ago – but amazingly scenarios did change little. Automatically detecting a meeting is still on the students slides. The more I learn and understand about context-awareness the more it becomes apparent that this apparently simple use case is amazingly hard!

Why shopping is fun – thoughts on intelligent user interfaces or why n=1 is not enough

Some weeks ago I saw for the first time one of the intelligent scales in the wild (=outside the lab). At that time I was really impressed how well it worked (sample size: n=1, product: banana, pack: no-bag, recognition performance: 100%). Last time I was too late so there was no time to play or see other people using it – but today I had some 5 minutes to invest.

The basic idea of the scale is simple and quite convincing. The customers put their purchase on the scales. A camera makes a guess what it is and the selection menu is reduced to the candidates that match the guess of the camera. Additionally, there is always a button to get all the options (as in the old version without the camera). It appears that this should make things easier.

I observed people trying to weigh different fruits and vegetables in bags and without bags (obviously I tried it myself, too). It did not work very often but interestingly people did not care much. It looked as most people did not really realise that this is meant to be an intelligent user interface. They probably just wondered why the display is showing always different things, but as they are intelligent themselves they found a way to deal with.

Overall it seems that it does really well on bananas which are not wrapped in a bag (my initial test case) and does not too well on many other things. I think the scales are an interesting example of a invisible interface.

Overall this is again a remainder that user tests that are small may be utterly wrong.

Panel on Sensor Networks – Applications are the Key

Debora Estrin made an interesting statement. The “early challenges” (the thousands or millions of randomly scattered sensor notes) do not have much applicability outside the battlefield. The new challenges are heterogeneity (specific sensors with specific capabilities) and interactivity (basically sense-making is a process where humans are involved). She made the point that the logical consequence is that dealing with data is the essential issue and statistics have an increasing role. Furthermore these new research directions make a stromg call for application driven research. With these very insightful comments she criticised a lot of the current work in sensor networks. Especially the observation that there is no such thing as a „general sensor“ – it points out that concrete applications are required to make meaningful contributions, even to basic research in sensor networks research.

Talks and Demos at PerCom 2007 in White Plains, NY

This year we (my previous group from LMU Munich) have a significant presence at PerCom. Form the 20 full papers the Embedded Interaction Research Group (www.hcilab.org) has 3, and additionally 1 of the 7 concise papers is from us. With a total of 207 submissions and an acceptance rate of around 10% this is quite an achievement for the team – and a good high point for the project before moving it to University of Bonn.

Gregor(y) Broll had the demo developed in the Perci-Project yesterday. Lucia Terrenghi and I had our talks today. And Gregor Broll, Sebastian Boring, and Raphael Wimmer have their talks tomorrow. Overall the conference has quite a diverse and interesting program, which seem to be more technical and network oriented than Ubicomp or Pervasive. The publications will be online available at the IEEE digital library or on our new publication webpage.

What can you do with a Wii controller? Use tape and connect a toothbrush and program a nice UI (fish tank) in Flash. Quite an interesting demo from Waseda University in Japan – at least the person who did the demo had really clean teeth in the evening.


PerTec Workshop in NY, Ripping off the Antenna

At PerCom 2007 (www.percom.org) Florian Michahelles (Auto-ID labs, ETH Zurich), Frédéric Thiesse (University of St. Gallen), John R. Williams (MIT Cambridge) and I are running the the PerTec workshop (www.autoidlabs.org/events/pertec2007). There is quite some interest in the topic and the range of topics is from technical to user interface and security.

In contrast to the workshop 1 year ago at Pervasive 2006 it seems that item level RFID-tagging is undisputed and that the only discussion point is when it is coming – in 6 month or 10 years. There is also still some discussion about what types of products are the first ones that are tagged – is it pharmaceuticals or cloth?

There was an interesting contribution by Paul Moskowitz from IBM, the clipped tag. It is a tag where you can physically rip off some part the antenna to reduce the read range from several meters to centimetres (see the pictures). It is really interesting that people can do a very clear and visible action to change the characteristics of a tag. The only questions that remains for me – will people trust that this really rips of the antenna? Probably yes…

The topics we discussed included security, privacy, location and RFID, end user issues, and connection of sensors to RFID, we hope to write it up in an overview article.

In the break out groups one discussion centered on the question what would we need to enable end-users to create novel applications using RFID? Further results of the discussion will be available on the workshop webpage soon.

The overall theme that emerged again and again is impact of real world constraints in RFID systems. Questions like: Can you achieve anonymity with a certain protocol? Can not be answered without knowing how it is used in the real world. Especially having recently learned a lot about data-mining (being at Fraunhofer IAIS) for me the questions of exploiting data collected in RFID systems looks really challenging.

Wearable Computing – Is it here?

10 years after I have got seen first see the crazy idea of wearable computing it appears that the technology is now really pushing into the marked. Even though one could argue whether or not this is really wearable computing (but this argument is as old as the idea of wearable computing). The last thing I would have expected 10 years ago was Bavarian Lederhosen with a built in user interface for an mp3-player. But nevertheless many challenges are still the same (integration with the aesthetics and fashion statement, durability and wash-ability, connectivity between computer and garment, integrated user interfaces) and some are nicely solved (http://www.smarttextiles.net/).

After Falke presented some years ago a sensor/ECG-t-shirt there was another one at CeBIT this year. It is not on the marked yet and it did not yet look fully convincing (you need to button in the electrodes). In our lab class on programming mobile systems we could use such a t-shirt. Currently we use stick on electrodes from http://www.alivetec.com/ which work really good but for the scenarios in mind having a t-shirt would be nicer.

In my recent entry on St. Petersburg I wondered about a communication glove. There was one on display – it includes only the essential (basically a speaker and a microphone) – but it enforced my opinion that creating a communication glove would be an interesting project. There were also hats with included speaker and microphones.

I was told that garments that keep warm – with active heating – are a hot topic 😉 Not fully convinced, but if projected consequently into the future it could change the way we dress completely. Want to show off you body at -20°C? Just power up the heating in your underwear a bit more and walk outdoors in your favourite summer dress without a coat. Not sure if this is the way we should push, I rather take my warm coat and save some energy. Apropos saving energy – there were interesting laptop bags with solar panels on the outside for harvesting energy.

CeBIT: Context-Awareness for Novel Transport and Logistics Services

At the Fraunhofer Forum at CeBIT I had the chance to talk about future transport solutions. One of my students in Munich (Michael Müller) is working on a pro-active transport container. In the project aware-goods (http://www.comp.lancs.ac.uk/~albrecht/awaregoods/) we looked into this domain already in 2000 at TecO together with SAP Research. Reiterating over the idea is really interesting as now the technology is really here – sensor network nodes are available, mobile phones offer massive processing power, there is ubiquitous data connectivity, and web service interfaces are available for many applications.

The big question is now on algorithms and software for context recognition and data mining in the collected sensor data, the integration with processes and company software systems, and the exploitation for optimising transport and logistics processes.

Affectionate Computing

Thecla Schiphorst introduced us in her talk “PillowTalk: Can We Afford Intimacy? to the concept of Affectionate-Computing.
The central question is really how can we create intimacy in communication an interaction with and through technology? The prototype showed networked soft objects, that include sensors that recognize tactile qualities and gesture interaction. There are more details in her paper published at TEI’07.

Nigel visiting, discussion on transportation

Nigel Davies from Lancaster University in the UK is visiting our group at Fraunhofer and b-it. It was really good to have some time – basically most of the day – to discuss interesting research questions and new direction in pervasive computing.

We discovered that we recently have both looked more into issues related to transport and tracking. I learned about possibilities for developing apps for the TomTom navigation system(which is running linux) and the trakm8 in-car-unit. We had a look at Michael Müller’s (master student I supervise in Munich) video of the smart transport container (more details on this at CeBIT).

Both of us are really interested how personal transportation is going to change and how computer science will make its contributions to that? The discussion on motives and motivations for choosing a particular mode of transport, what are the perceived values of certain transport modalities, and how can we influence them made me really think of implications of pervasive computing that are to come.

It is remarkable that as „cars“ become more programmable interesting research projects start at many different institutions looking into automotive computing on an application level with an aim for new user experience and additional services/functionalities.