Does anyone know what models / software this person is using? I assume it's something off the shelf, because there are an abundance of other videos in this space produced by different people:<p><a href="https://www.cnet.com/news/parks-and-recreation-ron-swanson-deepfaked-as-every-full-house-sitcom-character/" rel="nofollow">https://www.cnet.com/news/parks-and-recreation-ron-swanson-d...</a><p>I've been doing ML for audio (Tacotron, WaveRNN, etc.), but haven't stepped into the video world. I also work in film and want to apply this technique to my work.<p>How do they keep the frames from blurring or not needing to be rekeyed? The motion tracking is spot-on.<p>Would someone operating in this space be open to meeting over Hangouts or Skype to discuss the tech? I'd be happy to pay someone for a short survey of the space.
This video is helped by some superficial similarity between Hader and Cruise, and the transition to and from Seth Rogen's face is slightly less smooth. Still, this is incredibly well done.
The Arnold Schwarzenegger video from the same guys is arguably better: <a href="https://www.youtube.com/watch?v=bPhUhypV27w" rel="nofollow">https://www.youtube.com/watch?v=bPhUhypV27w</a>
This is the first deep fake I've seen that was good enough to fool a random Facebook user that wasn't looking for fakeness. Cool how far it's come.
Same creator as "Bill Hader impersonates Arnold Schwarzenegger", which I think is easier to see the shift in since there's less resemblance and higher quality: <a href="https://www.youtube.com/watch?v=bPhUhypV27w" rel="nofollow">https://www.youtube.com/watch?v=bPhUhypV27w</a>
Same user also did the Jim Carrey in Shining deepfake which is as well done as this and at times really unsettling. From now on I can safely say that I can't trust any video footage I see. This is that well done. The algos will only get better and do a convincing blend in 4K in the future.
Once that deep fake technology algorithm gets in the hands of the masses (Adobe Premiere After Effects plugin, Instagram/Snapchat filter, Apple Facetime filter, etc) ... so many obvious directions it will take:<p>- dating / flirting apps<p>- job candidates being interviewed remotely via webcams will use software to make them look younger<p>- "facelift" every television personality (news anchors, etc) and every movie actor. Both for creative purposes (younger/older timeline aging), for vanity, and for extending careers.<p>- generate fake but convincing political ads to put words in the mouth of opponent that he/she never said<p>- a growing distrust and skepticism of all videos <i>including archive footage</i> because we never had SHA256 authenticated hash of the old videos widely disseminated <i>before</i> deepfakes became ultrarealistic. E.g. There will be a subset of tomorrows kids that will not be convinced JFK ever actually said, <i>"landing a man on the moon"</i>. The WTC towers were never hit by airplanes. All that old footage will be dismissed as fake. Video evidence becomes useless. Yes, society will try to counteract it with software the detects deep fakes but some of the public still won't be convinced. (Same as evidence against anti-vaccine being rejected.)
I've been thinking a lot about this one, and it gets a ton of help in the fact that Bill Hader is actually good at facial impressions, and that's what really sells it.
Directors can use any actor to portray any character, and then make the character appear any way they want. Decouples acting talent from appearance.<p>Peter Jackson's Bolg and Azog could have been much more convincing, just 7 years on.
These are super cool, but it makes me wonder how much longer before we get to an era where video evidence is no-longer admissible in court.<p>Yeah, you can see occasional artifacts and glitches with current deepfakes, but surely the software will only get better.
Only on LSD have I seen faces change that seamlessly. There were a couple of spots that I noticed the transition, but that was like the 3rd viewing. I hope I never piss off someone with these abilities to make me say/do things I'd never imagine. The damage that can be done is mind boggling when used for that purpose.
<p><pre><code> Photos do not lie, it is said. But frequently they tell partial
truths. They tear moments out of time's flowing river and separate
them from what has come before and what will follow. They can
misrepresent as well as represent.
- JIM HOAGLAND</code></pre>
I liked this Tom Cruise Deepfake by Node from a month back: <a href="https://www.youtube.com/watch?v=3vHvOyZ0GbY" rel="nofollow">https://www.youtube.com/watch?v=3vHvOyZ0GbY</a><p>(With making-of.)