Category Archives: reading

‘Affective Computing’ – Affective Interaction

Over at, they have been publishing chapters of an online interaction design encyclopedia, where each chapter is written by an expert in a particular area in the field. I had come across it before for the chapter on Social Computing, which discusses crowd-sourcing type implementations of social computing such as wikipedia and scoring systems in e.g. Amazon and discussing mediated communication systems like twitter and facebook. A nice read and particularly a possibly helpful breakdown of crucial elements of such social systems.

Now I am posting as there is a thought provoking discussion of Affective Computing in response to a chapter of the same name written by Kristina Höök. The chapter  is followed by a well written response from prof. Roz Picard, who coined the term Affective Computing and drafted the first maps of that then poorly-charted terrain in her book Affective Computing. Next a rather artless response from one of the bigger names in the field of design and emotion, prof. Paul Hekkert. I do have to agree with the jest of his response. He amongst others, quotes the work on the compelling concept of ‘inherent feedback’ by my colleague and friend Miguel Bruns Alonso. The discussion centers on wether some HCI/AI approaches to Affective Computing is reductionist and cognitivist versus a more holistic and phenomenological approach to Affective Interaction that Höök describes. the Interactional Approach. That concept reminds me of the work of Stephan Wensveen, e.g. his paper at DIS in  2000 Touch Me, Hit Me and I Know How You Feel. A Design Approach to Emotionally Rich Interaction and then in his 2005 dissertation: A Tangibility Approach to Affective Interaction.

Against this backdrop I am currently reading the PhD thesis work of Joris Janssen, Joris’ work at first sight seems to take a reductionistic approach to empathic mediation (what he calls physiosocial technology), but particularly in the later chapters walks he shows examples of both a reductionist -lab based- approach and more holistic -real life- setting.
What fascinates me most in Joris’ work is the idea of technology that supports (even promotes?) empathy in dyads (2 people). Of particular interest for me is his (forthcoming) research on providing some form of feedback based on the correlation between one persons physiological signals and those of another. About a year ago Joris and I discussed social bio-feedback in more detail, after we got into contact over my Masters’ thesis on that topic and his paper on Intimate Heartbeats. Particular issue we discussed then was the modality of such feedback.


One end of the spectrum: Inspired by Cololo

I am building the slider systems (v01 and v02) to do some experiments from which we hope to study how varying qualities of an interaction medium influences the experience.
A project that shows a minimalist version of mediated interaction and telepresence, is Cololo, from the Uchiyama lab in Tsukuba. (be sure to have a look at some of their other projects)

I have now gotten my slider system to mimic the Cololo behavior as follows: When one slider is moved, the other slider moves randomly for about 4 seconds. During that period, the system does not respond to input on either slider.

I set out to maintain the possibility to have feedback on slider A about the random movement of slider B in response to the initial moving of slider A. However this proved rather tricky in a closed loop feedback system. It did teach me a thing or two about how to implement such behavior. Moreover it proved once more on the one hand that my current platform has its limits for more complex behaviors, and on the other hand my own limitations when it comes to ‘control systems’ theory and implementation.

Luckily the Cololo system doesn’t have any direct feedback, so for now I don’t need it. In my current code I applied a bit of a blunt method to get the Cololo behavior. In future iterations I will definitely need the feedback, so I will have to come up with a more elegant solution. I am now looking into possible collaborations with experts in the field of mechanical engineering and control systems theory.
My current arduino code for the Cololo behavior can be downloaded here (as a zip archive).

google scholar skimming

don’t forget to skim:

google scholar with force feedback in mediated interaction

google scholar with inTouch article