Hey HN! For the past year, our small startup has been focused on a single question: can we use generative AI to create genuinely new kinds of gameplay? Retail Mage is our first attempt at an answer.<p>I like to joke that Retail Mage is "late stage capitalism come for Diagon Alley." You and your friends are mages working the end of your shift at Mage Mart, seeking 5 star reviews from the wacky customers and trying not to burn the shop down, which sometimes happens.<p>We've built what we think is one of the more sophisticated implementations of GenAI in games so far. NPCs are powered by embodied AI agents that can observe their environment, plan actions, remember interactions, and engage in natural conversation. Going beyond AI agents, we also introduce an AI-based interaction system: Players and NPCs can just type or say what they want to do, and we translate that into the 3D simulation. This approach lets us bring "rulings, not rules" style gameplay to video games for the first time.<p>The technical journey has been... interesting! Some highlights:<p>- All inference runs in the cloud. We're part of Amazon's Generative AI Accelerator (the only gaming company)<p>- We manage inference ourselves, using some of the latest techniques in batching, forking and KV-cache reuse<p>- Over the last year, we've reduced our inference cost by 3 orders of magnitude<p>- After testing over two dozen models, we're currently using Google's Gemma<p>- We have our own in-house AI tools for Unreal Engine, including in-engine/runtime inference testing<p>- We developed our own natural language unit testing suite for our models and features<p>And we launch today! Try it out: <a href="https://store.steampowered.com/app/3224380/Retail_Mage/" rel="nofollow">https://store.steampowered.com/app/3224380/Retail_Mage/</a><p>Retail Mage is just the start. We have so many other prototypes and experiments. As a game developer, I'm legitimately excited to bring a new genre of games to players. Happy to answer questions!