Multi-touch displays seen as great opportunity

In our course “case studies in pervasive computing” we re-build systems that are described in the research literature and try to improve them or to apply them to new domains. This term the topic is on multi-touch displays. Starting out with Jeff Han’s paper “Low-cost multi-touch sensing through frustrated total internal reflection” we think about novel interaction methods for large screens. And after some initial problems (filter in the web cam we used) we have a first hardware prototype that shows the FTIR effect. The page of Thomas M. Brand is a good starting point if you too think of a DIY-project.

On Monday Giulio Jacucci from the Helsinki Institute for Information Technology told me that they set up a start-up that has an new interesting and different way of doing multi-touch displays – and they look into enormous sizes of displays, up to 16 meters long. Their web page is http://www.multitouch.fi/. Perhaps we should try to get some of there technology for next term – would save us some serious drilling, soldering and polishing…

Slowly settling in

Time is flying. We are nearly one month in Essen. Teaching started well and quite a number of students came to our course (see http://www.pervasive.wiwi.uni-due.de/en/teaching/). We have a reliable Internet connection and more furniture than we need 😉 Starting from scratch is a great experience – especially as everybody was very helpful.

Nevertheless it takes a lot of time and effort. I am extremly happy that I was able to start with a real team (Dagmar and Paul)!

Guest course at the University of Linz, MSc Pervasive Computing

I am teaching a guest course at the University of Linz in the Pervasive Computing master program. The topic is Unconventional User Interaction – User Interfaces in a Pervasive Computing World (http://www.ubicomp.net/uui). Today we started with an introduction to motivate how pervasive computing changes human computer interaction. I am already looking forward to the projects!

At dinner I learned why you can never have enough forks in a good restaurant. In case you loose your pen for the mobile phone a fork will do… The topic of the lecture is everywhere!

CardioViz Demo at Ubicomp 2007

Alireza Sahami presented our CardiViz project at the demo session at Ubicomp. We were very happy that the project that was the result of our IPEC course on developing mobile applications was accepted as a demo.

For more details see:
Alireza Sahami Shirazi, Diana Cheng, Oliver Kroell, Dagmar Kern, Albrecht Schmidt. CardioViz: Contextual Capture and Visualization for Long-term ECG Data. Adjunct Proceedings of Ubicomp 2007 (Demo).

Jonna Häkkilä, Anind Dey, Kari Hjelt, and I organized organized the Ubiwell workshop (Interaction with Ubiquitous Wellness and Healthcare Applications) at this years pervasive. Alireza presented another paper on heartbeat monitoring there:
Florian Alt, Alireza Sahami Shirazi, Albrecht Schmidt. Monitoring Heartbeat per Day to Motivate Increasing Physical Activity. UbiWell workshop@Ubicomp 2007.

Schools history, tangibles again

After my daughter started school on Saturday we visited a historic school on Sunday. Comparing teaching materials is interesting. Especially providing up to date information in geography must haven quite a costly task. Many expensive charts and maps that were printed on canvas are now freely available in digital form. It seems that instead of having a film project, a slight projector, an overhead projector and canvas displays a computer and projector with internet access will do. Similarly having stamps to reproduce maps seems like ancient history, even though it has been still in use 20 years ago.

However I wonder what we loose by make things digital and whether or not this matters. Having a database (a box with cardboard dividers and a lot of paper slips) or a typewriter (with types that are moved by pressing buttons) on your desktop gives you a very immediate impression how things work. It is remarkable to see that historically tangibility of teaching materials was very common.

I think in the digital we should make more effort to provide means that people can understand the mechanism behind the technology (basics of HCI – conceptual models :-). This is however extremely difficult for purely digital products. My generation seems very lucky to have been witnesses of this transformation for many products from the physical to the digital – providing a lot of insight to us.

Great tutorial on eXtreme Programming/Agile Methods

Today Karl-Heinz Sylla and Reinhard Budde (both senior researcher at Fraunhofer IAIS) gave for the summer research project a tutorial on agile methods for software engineering. The experience they have from large scale real world projects is impressive! We looked at different approaches to software construction and discussed the pros and cons. Short iterations, user stories, pair programming and test driven development seem to fit very well to our work approach and project goals. A good starting point for more on the topic in particular with a teaching perspective are the following 2 papers: LeJeune, N. F. 2006. Teaching software engineering practices with Extreme Programming. J. Comput. Small Coll. 21, 3 (Feb. 2006), 107-117 and Schneider, J. and Johnston, L. 2003. eXtreme Programming at universities: an educational perspective. In Proceedings of the 25th international Conference on Software Engineering (Portland, Oregon, May 03 – 10, 2003). International Conference on Software Engineering. IEEE Computer Society, Washington, DC, 594-599.

From a user interface engineering perspective is very positive that agile methods are good to integrate with user centred design – in my experience much better than traditional software construction processes. Especially the fact that XP (eXtreme Programming) is open to change in functionally throughout the process is a key.

In this summer research project one great challenge is that the students have to build up knowledge in various areas (e.g. search technologies, web technology, user interfaces) while creating high quality code. There is a very interesting paper that discusses software engineering issues in the context of web applications: Jazayeri, M. 2007. Some Trends in Web Application Development. In 2007 Future of Software Engineering (May 23 – 25, 2007). International Conference on Software Engineering. IEEE Computer Society, Washington, DC, 199-213.

Always when the discussion comes to programming languages a debate on strong typing starts. Especially in the web context this seems come up again and again…

the count down started – about 5 weeks to the prototype

Yesterday our summer project started at IAIS. The students are highly motivated and the combined skill set of the participants is impressive. We discussed a lot what we want to achieve over the next weeks.

Creating a new special purpose search service – basically from the rough idea to a working prototype – in 5 weeks seems a bit crazy but I am confident that we get there 😉 In certain areas we already have an idea how much pages we have to crawl and how much content we have to analyze.

It is interesting that it already now becomes apparent that user interface issues and system architecture decisions are closely linked. E.g. doing a meta search while the user is waiting requires some other content that we can present while the user is expecting the results.

Ubiquitous, Pervasive and Ambient Computing – Clarification of Terms

In the resent month the question about ubiquitous, pervasive, ambient computing came up several times. An email by Jos Van Esbroeck motivated me to write my view on it…

Clarifying the terms seems an ongoing process as various communities and individuals use each of those terms for new things they are doing.

For me the best way to discriminate the terms ubiquitous computing, pervasive computing, and ambient intelligence is by their origin, history and research communities.

The first term (ubiquitous computing, ubicomp) is linked to Mark Weiser and his vision of computing in the 21st century [1]. In the research community its is very much connected to ubiquitous and pervasive systems that have the user somewhere in the loop. The ubicomp conference [2] seems more focused on user experience than on pure technology.

Pervasive Computing was pushed in the mid 1990s, more by industry and in particular by IBM. Pervasive computing seems from its origin more focused on technologies and solutions than on a particular vision. The two major conferences related to this topic: pervasive [3] and percom [4] are more systems and network focused, however always keeping some attention to the user experience perspective. Here, in particular with percom, many in the research community have their origin in the networking and distributed systems world. To me pervasive computing seems more technical than ubiquitous computing and includes systems that do no have direct human users involved.

The term ambient intelligence was introduced by the European funding agencies in the Framework 5 vision. Around the same time as the Philips Home-lab that drives the term, too. Here, similar to ubicomp, the vision of a new quality of user experience is a driving factor. The research that falls under this label by now is broad and I think it is very similar to the research in ubiquious computing. There is also a European conference on ambient intelligence [5].

Many people that are involved in ubicomp/pervasive/percom are also active in one more traditional research community. In particular many people are additionally involved in user interface research (e.g. CHI-Community), mobile computing and mobile systems, networking and distributed systems.

A very early topic related to the whole field is context-awareness as introduced by Schilit [6] who was working with Weiser. In my PhD dissertation I have looked more into the relationship between ubicomp and context-awareness – it has the title Ubiquitous Computing – Computing in Context [7]

In parallel subtopic in the above field have emerged that look at specific aspects, e.g. internet of things [8] (not necessarily a human in the loop), wearable computing (computing in cloth), smart environments (computing in buildings and furniture), tangible and embedded interaction [9] (looking at the interaction side), smart objects, … and probably many more.

There is also an interesting trend that many of the topics, if they are a bit matured, move back into the traditional communities.

[1] Mark Weiser. The Computer for the Twenty-First Century. Scientific American 265, 3 (September 1991), 94-104
[2] http://www.ubicomp.org/
[3] http://pervasive2008.org/
[4] http://www.percom.org/
[5] http://www.ami-07.org/
[6] B. Schilit, N. Adams, and R. Want. (1994). „Context-aware computing applications„. IEEE Workshop on Mobile Computing Systems and Applications (WMCSA’94), Santa Cruz, CA, US: 89-101 .
[7] Albrecht Schmidt(2003). „Ubiquitous Computing – Computing in Context„. PhD dissertation, Lancaster Univeristy.
[8] http://
www.internetofthings-2008.org
[9] http://www.tei-conf.org/

Deadline for Summer@IAIS soon

Not much time left to apply for the student research project. From 20.8. to 30.9.2007 we plan to design and implement a new specific search engine. The program is open to all computer science and media informatics students, primarily in Germany. We assume it will be very competitive. For accepted students we provide a HIWI-job at Fraunhofer IAIS for the 5 weeks. It will be possible to get credits for the course (IPEC lab course at the University of Bonn).

For more information please see: www.iais.fraunhofer.de/summer2007.html