Show HN: Stable Diffusion powered level editor for a 2D game

I wonder how far off we are from something like the battle school game from the book Ender's Game. That is, an immersive video game that uses player actions, choices, exploration etc. in order to generate not only new content, but entirely new game rules on the fly. It feels like we're getting closer and closer to Ender's holographic terminal with VR interfaces + AI content.

While I have folks attention, I want to try training a model to generate monster/creature walk animations. Anyone know of a dataset of walk cycle sprite sheets that I could massage and label to see if I can make that work?

This is such a cool project. Very inspiring, thank you for posting it<p>Great example of using AI as a tool to make something exceptional

I feel like Jump &#x27;n Bump probably has a special place in the hearts of people who had access to the internet at a particular time. The internet was available, but multiplayer online gaming was still out of reach for many with it - there was an amazing niche of fairly polished indie local multiplayer games. Imagine being told while playing it back then what would be possible a few decades later.<p>(see also <a href="https:&#x2F;&#x2F;github.com&#x2F;midzer&#x2F;jumpnbump">https:&#x2F;&#x2F;github.com&#x2F;midzer&#x2F;jumpnbump</a>)<p>Now need someone to do other games of that time, place and genre: Tremor 3, C-Dogs, etc.

amazing advances this year. Remember the guy who created the 2d platformer thats based on time, what was it called again? He spent around $100k+ just for the art, which I am pretty sure was a huge expenditure for him, with this software he could have done it virtually for free without much artistic talent at all.

I was going to comment that that the contrast between the beautiful illustrations and red blood that violently explodes when you kill the opponent is pretty funny. But then I looked up the original Jump &#x27;n Bump and it&#x27;s just as gory, if not more! Good ol&#x27; 90s games.

Love to see a write up on your Hugging Face Diffusers experience, setting that up, what your dev cycle &amp; stack look like, if you&#x27;re hosting that server on a GPU cloud instance or what. Those kind of details are very interesting.

Does the 2d data like platforms and hit boxes still match the input entered by the human? If yes, I wouldn&#x27;t say this is using AI for level editing, this seems using AI for level artwork generation. Impressive nonetheless, just different.<p>HN&#x27;s submission title (&quot;Show HN: Stable Diffusion powered level editor for a 2D game&quot;) made me think of the former. Article title (&quot;2D Platformer using Stable Diffusion for live level art creation&quot;) was more accurate to me.

I&#x27;ve recently tried using InvokeAI to apply a specific style as a texture mod for the original Max Payne, along with RTX Remix. Instead of making the textures &quot;modern&quot;, I was attempting to mix them into a noir rendition, similar to Sin City, but less cartoonish. Unfortuantely, it was really hard to get InvokeAI to restrict to the UV boundaries, with data always leaking and not looking really good when rendered.

To get even less &quot;structured&quot; backgrounds you should try replacing the support backgrounds and the far backgrounds with a light bit of depth noise.

I&#x27;m also curious if anyone has made a level that worked particularly well&#x2F;poorly or has a great custom theme (that maybe I should add to the dropdown) :)

Very cool! When building it, did you encounter any unexpected obstacles, or found any cool tips that you&#x27;d like to share?

When they start making games like GTA with generative AI we will get to the real fun

Seems like a good source of cheap visual design!

I wish this was around when I was a kid :(

Would love to see a video of the game

This is good for procedural generated 2D worlds. Think Hollow Knight, but expansive across infinite environments. Just randomly generate the control image and have the LLM generate the theme. Combine that with LLM generated lore and the possibilities are unlimited.<p>We have the technology to do this right now.