The special effects team on Ex-Machina overlaid graphics onto the actor. There were scenes where the actor was "motionless" but they observed that the emotional experience of the film required animated overlaid motion to match the actor.<p><a href="http://www.theverge.com/2015/5/8/8572317/ex-machina-movie-visual-effects-interview-robot-ava" rel="nofollow">http://www.theverge.com/2015/5/8/8572317/ex-machina-movie-vi...</a><p><i>"We also put a lot of effort into things like the muscles contracting properly, and the various pipes and wiring having just a tiny amount of jiggle. And it’s something that you really do not notice. But I remember when we were looking at shots, for whatever reason when we put a shot through to render overnight that secondary animation hadn’t rendered properly, so it was missing. And everything suddenly felt very stiff. And you kick the shot off again, this time with that animation integrated into it, and it works again. It’s not something that you can necessarily put your finger on as being wrong, but if it’s missing then you suddenly feel that something’s strange."</i>
Here's another video of the algorithm being tested against a wider range of targets.<p><a href="https://www.youtube.com/watch?v=AGA6eJXZAOw" rel="nofollow">https://www.youtube.com/watch?v=AGA6eJXZAOw</a><p>The ability to pick up saccades could have interesting HCI implications if the signal is consistent.
Interesting talk by one of the researchers on the techniques including recovery of audio from video of passive object vibrations:<p><a href="http://www.ted.com/talks/abe_davis_new_video_technology_that_reveals_an_object_s_hidden_properties" rel="nofollow">http://www.ted.com/talks/abe_davis_new_video_technology_that...</a>
How does it compare to Eulerian Video Magnification?<p><a href="http://newsoffice.mit.edu/2012/amplifying-invisible-video-0622" rel="nofollow">http://newsoffice.mit.edu/2012/amplifying-invisible-video-06...</a>