Two basic references for interaction byond the desktop

Following the workshop I got a few questions on what the important papers are that one should read to start on the topic. There are many (e.g. search in google schoolar for tangible interaction, physical interaction, etc and you will see) and there conference dedicated to it (e.g. the tangible and embedded interaction TEI – next week in cambridge).

But if I have to pick two here is my joice:

[1] Ishii, H. 2008. Tangible bits: beyond pixels. In Proceedings of the 2nd international Conference on Tangible and Embedded interaction (Bonn, Germany, February 18 – 20, 2008). TEI ’08. ACM, New York, NY, xv-xxv. DOI= http://doi.acm.org/10.1145/1347390.1347392

[2] Jacob, R. J., Girouard, A., Hirshfield, L. M., Horn, M. S., Shaer, O., Solovey, E. T., and Zigelbaum, J. 2008. Reality-based interaction: a framework for post-WIMP interfaces. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 – 10, 2008). CHI ’08. ACM, New York, NY, 201-210. DOI= http://doi.acm.org/10.1145/1357054.1357089

What happens if Design meets Pervasive Computing?

This morning I met with Claudius Lazzeroni, a colleague from Folkwang Hochschule (they were part of our University till two years ago).
 
They have different study programs in design and art related subjects. He showed me some projects (http://www.shapingthings.net/ – in German but lots of pictures that give you the idea). Many of the ideas and prototypes related to our work and I hope we get some joint projects going. I think it could be really exciting to have projects with design and computer science students – looking forward to this!
When I was in the UK we collaborated in the equator project with designers – mainly Bill Gaver and his group – and the results were really exciting [1]. We build a table that reacted to load changes on the surfaces and allowed you to fly virtually over the UK. The paper is worthwhile to read – if you are in a hurry have a look at the movie about it on youtube: http://www.youtube.com/watch?v=uRKOypmDDBM
There was a further project with a table –  a key table – and for this one there more funny (and less serious?) video on youtube: http://www.youtube.com/watch?v=y6e_R5q-Uf4
[1] Gaver, W. W., Bowers, J., Boucher, A., Gellerson, H., Pennington, S., Schmidt, A., Steed, A., Villars, N., and Walker, B. 2004. The drift table: designing for ludic engagement. In CHI ’04 Extended Abstracts on Human Factors in Computing Systems (Vienna, Austria, April 24 – 29, 2004). CHI ’04. ACM, New York, NY, 885-900. DOI= http://doi.acm.org/10.1145/985921.985947

Interesting interaction devices

Looking at interesting and novel interaction devices that would be challenging for students to classify (e.g. in the table suggested by Card et al 1991 [1]) I can across some pretty unusual device. Probably not really useful for an exam but perhaps next year for discussion in class…

Ever wanted to rearrange the keys on your keyboard? ErgoDex DX1 is a set of 25 keys that can be arranged on a surface to create a specific input device. It would be cool if the device could also sense which key is where – would make re-arranging part of the interaction process. In some sense it is similar to Nic Villar’s Voodoo I/O [2].
Wearable computing is not dead – here is some proof 😉 JennyLC Chowdhury presents intimate controllers – basically touch sensitive underwear (a bra and briefs). Have a look at the web page or the video on youtube.
What are keyboards of the future? Each key is a display? Or is the whole keyboard a screen? I think there is too much focus on the visual und to less on the haptic – perhaps it could be interesting to have keys that change shape and where the tactile properties can be programmed… 
[1] Card, S. K., Mackinlay, J. D., and Robertson, G. G. 1991. A morphological analysis of the design space of input devices. ACM Trans. Inf. Syst. 9, 2 (Apr. 1991), 99-122. DOI= http://doi.acm.org/10.1145/123078.128726 
[2] VILLAR, N., GILLEADE, K. M., RAMDUNYELLIS, D., and GELLERSEN, H. 2007. The VoodooIO gaming kit: a real-time adaptable gaming controller. Comput. Entertain. 5, 3 (Jul. 2007), 7. DOI= http://doi.acm.org/10.1145/1316511.1316518

Ranking Conferences and Journals – A Down-Under perspective

As many of us I am skeptical of rankings (as long as I was not involved in making them 😉 Nevertheless sometimes they are interesting and helpful in assessing where to publish or what better not to read…

This morning we discussed where to publish some interesting work related to web technology (a follow-up of the UsaProx) and for the discussion such a list may have been helpful. 
A colleague from Munich sent me the link to an Australian conference ranking and obviously they also have ranked Journals, too. They use A+, A, B, L, and C as tiers.
… and as we always knew you cannot be wrong when publishing in Pervasive, Percom, Ubicomp, and CHI 🙂

Technology Review with a Focus on User Interfaces

The February 2009 edition of technology review (German version) has its focus on new user interfaces and titles „Streicheln erwünscht“ (translates to stroking/caressing/fondling welcome). It has a set of articles talking about new way of interacting multimodality, including tangible user interfaces and tactile communication. In the article „Feel me, touch me“ by Gordon Bolduan on page 74 a photo of Dagmar’s prototype of tactile steering wheel is depicted. The full paper on the study will be published at Pervasive in May 2009 (so you have to be patient to get the details – or come and visit our lab 😉

In the blog entry of technology review  introducing the current issue there is a nice anecdote mentioned about a literature search on haptic/tactile remote communication (while I was still in Munich) – the final version of the seminar paper (now not X-rated anymore) is „Neue Formen der entfernten Kommunikation“ by Martin Schrittenloher. He continued in his MSc Project on the topic and worked with Morten Fjeld  on sliders that give remote feedback, see [1].

Another topic closely related is to new forms of communication are exertion interfaces (we looked at the 2002/2003 work Florian ‚Floyd‘ Mueller in the UIE lecture yesterday – even with the Nintendo Wii around the work is highly inspiring and impressive, see [2]). The communication example given in Breakout for Two is showing the potential of including the whole body in communication tasks. Watching the video  is really to recommend 🙂
[1] Jenaro, J., Shahrokni, A., Schrittenloher, and M., Fjeld, M. 2007. One-Dimensional Force Feedback Slider: Digital platform. In Proc. Workshop at the IEEE Virtual Reality 2007 Conference: Mixed Reality User Interfaces: Specification, Authoring, Adaptation (MRUI07), 47-51
[2] Mueller, F., Agamanolis, S., and Picard, R. 2003. Exertion interfaces: sports over a distance for social bonding and fun. InProceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA, April 05 – 10, 2003). CHI ’03. ACM, New York, NY, 561-568. DOI= http://doi.acm.org/10.1145/642611.642709  

Why can I not rotate my windows on my Vista Desktop?

In the User Interface Engineering lecture we discussed today input devices, especially to interact with 3D environments. In 3D environments having 6 degrees of freedom (3 directions in translation and 3 options for rotation) appears very natural. Looking back at 2D user interfaces with this in mind one has to ask why are we happy (an now for more than 25 years) with translation (in 2D) only and more specifically why is it not possible to rotate my application windows in Vista (or perhaps it is and I just dont know it). At first this questions seems like a joke but if you think more of it there could be interesting implication (perhaps with a little more thinking
 than this sketch 😉

Obviously people have implemented desktops with more than 2D and here is the link to the video on project looking glass – discussed in the lecture. (if you are bored with the sun sales story just move to 2:20): http://de.youtube.com/watch?v=JXv8VlpoK_g
It seems you can have it on Ubuntu, too: http://de.youtube.com/watch?v=EjQ4Nza34ak

Desktop Video Conference – Setup time 5 Seconds

Earlier I had a tele-conference with Christian Becker and Gregor Schiele (we still try to write a book 😉 and I tryed MeBeam.com for the video. And to my great suprise it work instandly and well and the conference setup took about 5 seconds – open website, chose a name for the conference, distribute the link over skype. And as one can see video adds another quality to the conversation 🙂

Rating your professor, teacher, doctor, or fellow students?

This morning I was coming back from Munich* on the train I got a phone call from a journalist from Radio Essen (http://www.102.2radioessen.de/). As their studio is very close to the railways station in Essen I went there spontaneously before going back to University. 

We talked a little about web services for students to rate their profs (e.g. meinProf.de). The numbers of ratings most professors have received so far is extremely small (in comparison to the number of students we teach) and hence you get interesting effects that are far from representative or in many cases even meaningful. Last term I registered my course and we sent proactively a mail to all students who complete the course with the request to rate the lectures. This seems to be a good way to generate a positive selection 🙂
There are many of these services out – rating teachers, doctors, shops, etc. Thinking a little more about the whole concept of rating others one could image many interesting services – all of them creating a clear benefit (for someone) and a massive reduced privacy for others. 
To make it more specific I offer you one idea: Rate your fellow students‘ professonal capabilities and academic performance. Students have typically a very good insight into the real qualities of their peers (e.g. technical skills, social compatibility, creativity, mental resilience, ability to cope with workload, diligence, honesty etc.). Having this information combined with the official degree (and the transcript the university offers) a potential employer would get a really interesting picture… We discussed this with students last term an the reactions were quite diverse – as one can image.>
Obviously such a service would create a lot of criticism (which lowers the cost of marketing) and one would have to carefully think in which countries it would be legal to run it. An interesting question would also be what verification one would employ to ensure that the ratings are real – or perhaps we would not need to care? Interested in the topic – perhaps we should get 5 people together implemented in a week and get rich 😉 
The direction of such rating systems are taking is very clear – and it seems that they will come in many areas of our life. Perhaps there is some real research in it… how will these technology change the way we live together?

* travelling from Munich (leaving at 22:30) and arriving in Essen in the morning (or Darmstadt) works fairly well and if you stay in a hotel in Stuttgart 😉 – it is surprisingly a real alternative to a night train or an early morning flight…

Mechanical Computing, Beauty of Calculating Machines

Instead of covering the history of calculating machines in the DSD lecture, we took the train and went to the Arithmeum in Bonn to the see the artefacts live and to play with some of them.
We started with early means for counting and record keeping. The tokens and early writings did not use numbers as abstract concepts, rather as representatives of concrete objects – this is very inspiring, especially from a tangible interaction point of view. The knots, as used in south America, show impressively how the tools for calculation have to fit the context people live in. Interestingly all these artefacts highliht how the ability to calculate and store information is related to the ability to do trade – quite a good motivation for the setup we have in Essen business studies and computer science within one faculty.
I was again impressed by the ingenuity by the early inventers of calculating tools and machines. There is an interesting separation between calculating tools and machines – the first ones require the user to take care of the carry and the second do it by themselves. We tried out replicas of Napier’s calculating tool and Schickard’s calculating machine.
The beauty and the mechanical precision required of those early machines is impressive. These prototypes (most of them took years and massive funds to be built complete) can teach us something for research today. These inventors had visions and the will to get it implemented, even without a clear application or business model in mind. They were excited by the creating of systems than can do things, machines could not do before. From the professions of the inventors (e.g. Philipp Matthäus Hahn was a clergyman)  it becomes apparent that at these times some considered religion and calculation as closely related – which to mondern understanding is very very alien.

Seeing the Hollerith machine that was used for the US census more than 100 years ago can teach you a lot about data processing. Punch cards, electrical reading and electrical counters (using mainly relays) were the basis for this technology. Looking at the labels on the counters showed that the US has a long tradition in collecting data that is after some time is not seen as political correct 😉
Having learned binary calculations during the DSD course it was nice to see a machine that did binary additions, using small steel balls and gravity. On each place (1,2,4,8, …) there is space for one ball. If a second one comes to this place one moves up to the next place (carry) and one is discarded. This is implemented with very simple mechanics and the working prototype (recently build) is based on designs of Schickard (but he never built – if I am correct).
Moving on with binary systems and finally to silicon, we got to see the Busicom 141 – a desk calculator that uses the Intel 4004. It is impressive to see that this is not even 40 years ago – starting with 2300 transistors and 180kHz. 
you can find the full set of photos at: http://foto.ubisys.org/dsd0809/

CfP Workshop on Pervasive Advertising

We organize at this year’s Pervasive computing conference in Nara, Japan a workshop on Pervasive Advertising – http://pervasiveadvertising.org
We expect that there is a lot of interesting research going on in the area and it is clearly a controversial topic. Being an optimist – I see the new options that arise. In particular a future with less annoying advertisements is one hope 🙂
But many people are focusing on the risks that arise – an interesting positing with some criticism of our workshop objective can be found at the near future laboratory  I do not share their views 🙂
To me the idea that if you do not research it, it does not happen seems not a very viable option. I still think with research we can shape the future!
I am already looking forward to the submission and to the workshop. You have a contribution? Deadline is Feb, 11 2008.