![\"facial.jpg\"](\"http:\/\/www.randform.org\/blog\/wp-content\/2006\/08\/facial.jpg\")
<\/p>\n<\/p>\n
“empathic paintings” by Shugrina, Betke and Collomosse<\/p>\n
For obtaining their device they use 8 facial expressions (read in via a webcam) classified by means of the facial action coding system FACS<\/a>, map these onto a 2D parameter space (which is called Russels 2D pleasure-arousal space) and use this 2D space for a certain painterly rendering algorithm (see above image). The device works in real time.<\/p>\n Using gestures or facial expressions as an interface is not something new and they write themselves that their work is in the spirit of e.g. the work of Hertzman and Perlin<\/a>. However in principle I think there is a lot of research necessary until facial expressions and gestures may be really used for high sensible interfaces. There are similar problems like for the case of voice recognition (see e.g. previous post<\/a>).<\/p>\n Remark: From the images on their website and in the paper it seems that e.g. anger gives a more red coloured image, fear blue etc. I am asking myself how much of these rendering desicions are culturally motivated. <\/p>\n","protected":false},"excerpt":{"rendered":" “empathic paintings” by Shugrina, Betke and Collomosse<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[21,8,6,14],"tags":[],"_links":{"self":[{"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=\/wp\/v2\/posts\/326"}],"collection":[{"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=326"}],"version-history":[{"count":0,"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=\/wp\/v2\/posts\/326\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=326"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=326"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=326"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\nYou probably know these filters in e.g. photoshop or gimp<\/a>, with which you can make a fotograph of last sunday’s family vacation look like Seurat’s sunday afternoon.<\/a> (let’s say almost :-)) These flters are using socalled “painterly rendering algorithms”, i.e. mathematical algorithms which deform your image into the desired way. They belong to a class of “nonphotorealistic rendering techniques” (NPR’s), which have been of certain interest also to the movie industry. Imagine that your interface is now not a boring fotoshop or gimp navigation bar, but that you can choose the algorithm via your own facial expression. Then you have an “empathic painting” in the sense of Shugrina, Betke and Collomosse<\/a>.
\n![\"facialspace.jpg\"](\"http:\/\/www.randform.org\/blog\/wp-content\/2006\/08\/facialspace.jpg\")
<\/p>\nFrom the paper<\/a> of Shugrina, Betke and Collomosse <\/div>\n
![Seurat’s sunday afternoon.<\/a> (let’s say almost :-)) These flters are using socalled “painterly rendering algorithms”, i.e. mathematical algorithms which deform your image into the desired way. They belong to a class of “nonphotorealistic rendering techniques” (NPR’s), which have been of certain interest also to the movie industry. Imagine that your interface is now not a boring fotoshop or gimp navigation bar, but that you can choose the algorithm via your own facial expression. Then you have an](\"http:\/\/en.wikipedia.org\/wiki\/Image:Sundayafternoon.JPG\"){kind=link}