I suspect the main impact will be on cutscenes, trailers for games in very early development, etc rather than on the gameplay itself. It's all well and good creating videos in this way, but creating environments that both look good and run well enough to keep a mostly consistent 60fps framerate are very different things, and I don't think Sora AI has even remotely been optimised for the latter.
I think you could do style transfer on a framebuffer before pushing it out and that might be quite interesting, especially if you can have it look correct over time.<p>The larger possibility is that video has shown the AI has some capacity to preserve structure overtime. The objects in the video maintain their dimensions and appearance as we would expect. This suggests there's some representation of objects or an equivalent to it. If that could be controlled more then potentially you have the ability to hold something like a game in working memory and iterate on parts of it.
I don't see a direct effect on making the game. But UA is a different story now.<p>You know those clickbaity mobile game ads you see everywhere on FB, Youtube, etc? Things are about to get 100x worse with video AI like Sora.
I'm still waiting for plain old GPT to impact the gaming industry. There's fertile ground for a lot of new things with the tech. One of the cooler things I saw was a mod that gave Skyrim characters some personality. But so far even the text stuff has been below expectations. DALL-E and Midjourney have the potential to churn out game assets, but we've seen very few hits done this way as well.
Generating a video offline and doing it in real-time are very different problems<p>You can spend days generating one frame of the video offline<p>Whereas realtime you need to generate a frame in the magnitude of 30-40ms
I think that at this stage Sora AI is not something that can be used in the game industry at all. On the other hand, I don't rule out that AI is developing so fast that soon we will see Sora AI or other AI working in the game industry, many people will be out of a job.