Voice interaction – Perhaps it works …

Today we visited Christian Müller at DFKI in Saarbrücken. He organized a workshop on Automotive User Interfaces at IUI last week. My talk was on new directions for user interfaces and in particular arguing for a broad view on multimodality. We showed some of our recent projects on car user interfaces. Dagmar gave a short overview of CARS our simulator for evaluating driving performance and driver distractions and we discussed options for potential extensions and shortcomings of the Lane Change Task.
Being a long time skeptic about voice interfaces I was surprise to see a convincing demo of a multimodal user interface combining voice and a tactile controller in the car. I think this could be really an interesting option for future interfaces. 
Classical voice-only interfaces usually lack basic properties of modern interactive systems, e.g. as stated in Shneiderman’s Golden Rules or in Norman’s action cycle. In particular the following points are most often not well realized in voice-only system:
  • State of the system is always visible
  • Interactions with the system provide immediate and appropriate feedback
  • Actions are easily reversible
  • Opportunities for interaction are always visible 
By combing a physical controller with voice and having at the same time the objects of interaction visible to the user (as part of the physical system that is controlled, e.g. window, seat) these problems are addressed in a very interesting way. I am looking forward to seeing more along these lines – perhaps we should also not longer ignore speech interaction in our projects 😉 

Towards interaction that is begreifbar

Since last year we have in Germany a working group on graspable/tangible interaction in mixed realities.
In German the key term we use is “begreifbar” or “begreifen” which has the meaning of acquire a deep understanding of something and the words basic meaning is to touch. Basically understand by touching – but in a more fundamental sense than grasping or getting grip. Hence the list of translations for “begreifen” given in the dictionary is quite long.
Perhaps we should push more for the word in the international community – Towards interaction that is begreifbar (English has too few foreign terms anyway 😉

This meeting was organized by Reto Wettach at Potsdam and the objective was to have two days to invent things together. The mix of people mainly included people from computer science and design. It is always amazing how many ideas come up if you put 25 people for a day in a room 🙂 We followed this week up on some of the ideas related to new means for communication – there are defiantly interesting student projects on this topic.

In the evening we had a half pecha-kucha (each person 10 slides of 20 seconds – in total 3:20, the original is 20 slides) http://www.pecha-kucha.org/. It is a great way of getting quickly to know about work, research, ideas, and background of other people. It could be format we could use more in teaching a perhaps for ad-hoc sessions at a new conference we plan (e.g. http://auto-ui.org) … prepared my slides on the train in the morning – and it is more challenging that expected to get a set of meaningful pictures together for 10 slides.

Overall the workshop showed that there is a significant interest and expertise in Germany moving from software ergonomics to modern human computer interaction.
There is a new person on our team (starting next week) – perhaps you can spot him on the pics.
For a set of pictures see my photo gallery and the photos on flickr.

Mechanical Computing, Beauty of Calculating Machines

Instead of covering the history of calculating machines in the DSD lecture, we took the train and went to the Arithmeum in Bonn to the see the artefacts live and to play with some of them.
We started with early means for counting and record keeping. The tokens and early writings did not use numbers as abstract concepts, rather as representatives of concrete objects – this is very inspiring, especially from a tangible interaction point of view. The knots, as used in south America, show impressively how the tools for calculation have to fit the context people live in. Interestingly all these artefacts highliht how the ability to calculate and store information is related to the ability to do trade – quite a good motivation for the setup we have in Essen business studies and computer science within one faculty.
I was again impressed by the ingenuity by the early inventers of calculating tools and machines. There is an interesting separation between calculating tools and machines – the first ones require the user to take care of the carry and the second do it by themselves. We tried out replicas of Napier’s calculating tool and Schickard’s calculating machine.
The beauty and the mechanical precision required of those early machines is impressive. These prototypes (most of them took years and massive funds to be built complete) can teach us something for research today. These inventors had visions and the will to get it implemented, even without a clear application or business model in mind. They were excited by the creating of systems than can do things, machines could not do before. From the professions of the inventors (e.g. Philipp Matthäus Hahn was a clergyman)  it becomes apparent that at these times some considered religion and calculation as closely related – which to mondern understanding is very very alien.

Seeing the Hollerith machine that was used for the US census more than 100 years ago can teach you a lot about data processing. Punch cards, electrical reading and electrical counters (using mainly relays) were the basis for this technology. Looking at the labels on the counters showed that the US has a long tradition in collecting data that is after some time is not seen as political correct 😉
Having learned binary calculations during the DSD course it was nice to see a machine that did binary additions, using small steel balls and gravity. On each place (1,2,4,8, …) there is space for one ball. If a second one comes to this place one moves up to the next place (carry) and one is discarded. This is implemented with very simple mechanics and the working prototype (recently build) is based on designs of Schickard (but he never built – if I am correct).
Moving on with binary systems and finally to silicon, we got to see the Busicom 141 – a desk calculator that uses the Intel 4004. It is impressive to see that this is not even 40 years ago – starting with 2300 transistors and 180kHz. 
you can find the full set of photos at: http://foto.ubisys.org/dsd0809/

Biometrics will come, who will care about privacy

Arriving at the new Terminal 5 at Heathrow airport I saw some extra installations (and extra lines) for iris scan immigration. Arriving at 4 am in the morning they were closed and there were not queues – but I could see that it is very attractive at other times of day when queues are long. On the official website they claim that border control will be down to 20 seconds. There is a more detailed document on the schema – I saved the document to have it in 10 years when we will have a very different view on privacy.

Will we have face-2-face PC meetings in the future?

On Thursday morning I flew to Boston for the CHI 2009 PC meeting. The review and selection process was organized very professional and efficient. We discussed all papers in one and a half days – and I think an interesting program came out and I learned a lot about what values my colleagues see or see not in papers. On Friday afternoon I flew back to the UK for the Pervasive 2009 PC meeting in Cambridge (with the same crew on the plane).

Nevertheless the question remains how sustainable is it that 100 people fly to a face-2-face meeting. In what way could we do such a meeting remotely? Video conferencing still does not really work well for larger group discussions (just collecting experience here in Cambridge during the Pervasive PC meeting)… Can it be so difficult to make a reasonable video link between two meeting room? How could we recreate the social aspects (like a joined dinner or walking back through the city with Gregory) as well as side conversations in the meetings? We probably should try harder – It cannot be that difficult – there have been massive amounts of work in CSCW research? Perhaps we should try linking two rooms at different universities as a group project next term? 

Exporting your cars information to the mobile phone

In our user interface engineering class one of the tasks in the exercise is to create a concept design for providing information from the car on the mobile phone (e.g. millage, amount a fuel in the car, next service date, alram status, etc). The first part is to assess what information could be made accessible and what value it would create for the user. 
Today I came across a device (Tyredog TD-1000A) that is concerned with a one sub-part of this scenario: checking your pressure in the tires of the car. It is a simple sensor system, screwed on to each of the tires, connected to a wireless receiver. There is also a version that includes features for the car alarm (Tyredog TD-3000A).
Another group is looking yet again into the domain of  restaurant finders or more general night life. Apropos restaurant finders, Saturday night we got out of the subway onto union square and discussed where to go for dinner (an we probably looked disoriented). A local lady stoped and recommended the Union Square Café – and it was just great… sometimes just talking to someone in the street may provide you with an excellent alternative to technologies 😉 Perhaps the students find a solution that can reflect personal recommendations well…

Information vs. Mobility, Percom PC meeting in New York

The PC meeting for Percom 2009 took place at IBM in Hawthorne, NY. Percom had about 200 submissions and many good ones – so we could compile an exciting program across the whole field of pervasive computing and communication. As one of three program vice chairs I have looked in detail in about 1/3 of the submissions that were application related. It is interesting to observe that research as a whole in the field becomes more major and at the same time more incremental. 

To me this puts up the big question in which domains will the new big innovations happen, what is the next trend after we have pervasive computing? There are luckily plenty of options, but at the moment it seems that there develops an interesting relationship between information, communication, mobility and energy. It seems that we can compensate mobility by information and communication and similarly we can reduce energy required by information available. One example is: if I know where things are (=information) I can reduce the effort required to find them (=mobility). Is there more to it?
Each time in the US – even in New York were public transport works quite well – one is surprise how alien it appears to many that it could be an option to take public transport on a business trip (e.g. there are no first class coaches on regional trains). Flying from Düsseldorf into Newark it was convenient to take the train to Penn Station in NY City and then an express train to White Plaines. If we would not have gone for a walk in the city we probably would have been equally fast as by car. With the again low gas prices in the US (less than 2U$ per gallon, down from 4 just a few month ago) I would expect public transport and small cars will not gain too much popularity – before the next rise in gas prices.

PS: it is amazing how many possiblities there are to serve coffee (and this is probably not one of the most environment friendly)

My first hotel fire alarm, debugging smart environments

We arrived in the evening in Köln and went to our hotel and around 10:30 pm the fire alarm sounded (really loud – you want to leave) and a voice over the speaker system asked us to leave the hotel immediately. When we checked in an hour earlier we overheard that they called for the elevator repair man…

Better safe than sorry I packed up my laptop and rucksack and we went downstairs. At the reception they were pretty busy – but it seemed everyone clear that this a false alarm but it seemed they had no way of really understanding why the system behaved in this way [gap of evaluation 😉 teaching user interface engineering this term]. The error search reminded me on one error search strategy in C (if you do not have a debugger). Comment out part of the code (here: disable fire sensing for certain areas in the hotel) till you can tell which parts cases the error. If you have found this part and it is not essential just leave it as a comment (you can do the same with fire sensor – hope they did not…)

A fire alarm system has compared to smart environments we envision a very low complexity. I think providing appropriate means for debugging smart environments by end-users could be a topic worthwhile to look at.
PS: the elivator had the best display for showing the level you are in I have seen so far. From a UI perspective it is really a boring recreation of the non-digital version… 

Trip to Dublin, Aaron’s Display Project

Visiting Dublin is always a pleasure – even if the weather is rainy. Most of the day I was at Trinity College reading master theses (which is the second best part of being external examiner, best part is to have lunch at the 1592 😉
In the evening I met with Aaron Quigley and we talked about some ongoing display and advertsing projects in our groups. He told me about one of their recent workshop papers [1] on public displays where they investigated what people take in and what people remember of the content on displays in an academic environment. It is online available in the workshop proceedings of AIS08 [2]. I found it worthwhile to browse the whole workshop proceedings.
[1] Rashid U. and Quigley A., „Ambient Displays in Academic Settings: Avoiding their Underutilization“, Ambient Information Systems Workshop at UbiComp 2008, September 21, Seoul, South Korea (download [2], see page 26 ff)

Which way did you fly to Korea?

We got a new USB GPS tracker(from Mobile Action, GT100) and had to try it out on the trip to Korea. It worked very well compared to the other devices we had so far. It got the bus trip in Düsseldorf airport right and the entire flight from Amsterdam to Seoul. Tracking worked well in the taxi from the Airport to the hotel. While walking in downtown Seoul it still performed OK (given the urban canyons) with some outliers.

It did not get any signal while we were on the Fokker-50 from Düsseldorf to Amsterdam 🙁 I slept a few hours on the flight to Seoul but I think someone took a photo (probably of me) over Mongolia… If you wonder if it is allowed to used your GPS in the plane or not – it is – at least with KLM (according to a random website http://gpsinformation.net/airgps/airgps.htm 🙂