Text2LIVE: Text-Driven Layered Image and Video Editing

We're still in the first innings of this stuff. Zero-shot/CLiP work will extend to audio, music, music videos and perhaps full movies. I would love to see: "The Phantom Menace with Jar Jar Binks replaced by leonardo dicaprio using the voice of James Earl Jones"

That&#x27;s really cool, and could realistically end up being very useful as an end-user product.<p>I&#x27;m just waiting for the GIF keyboard that creates GIF&#x27;s based on your prompt instead of searching through an existing database of them.<p>That will be truly next-level.

This just reinforces my hypothesis that OpenAI&#x27;s release of CLIP on 2021 was more impactful to image research than the DALL-E paper.

<i>fire out of bear&#x27;s mouth</i><p>Finally a way for the Asylum* to cut VFX techs and editors out of the loop altogether and allow producers to keep the good cocaine for themselves.<p>* the people who brought you the <i>Sharknado</i> franchise

Looks promising. I think this would end up with some well-defined schema + some DSL.

how long until we can write stuff like: make everybody nude in this kpop video?

Our best minds are working on this amazing near-magical new technology.. which will end up being productized into an Instagram Filter service to dynamically inject a stained glass unicorn in place of a horse in a video.<p>That&#x27;s cool and all, but also really stupid and a pointless distraction compared to how novel the underlying mathematics and science are. This will quickly become a commodity and humans will acclimate to seeing such tricks. The content produced won&#x27;t even be considered particularly impressive.<p>Damn. I was hoping the singularity would be better.