We’re writing and illustrating a digital zine on building LLM evals. It’s set in a world where forest creatures learn how to prompt the LLM shoggoth living in the canopy of their home.<p>We wrote this zine for AI engineers that have heard of evals, but don’t know where to get started building their own evals.<p>The inspiration from the meme that LLMs are an alien intelligence that we put a mask on to make it palatable for us. Juxtaposing it against forest animals seemed amusing, and a way for us to do some world-building and fun as well.<p>In case you miss it on the landing page, here are some sample pages and table of contents (subject to minor changes). <a href="https://forestfriends.tech/assets/preview.pdf?v=5a28faee96" rel="nofollow">https://forestfriends.tech/assets/preview.pdf?v=5a28faee96</a>