Hey HN, I’m Ben, and I’ve been tinkering with prompt-iteration tooling for about a year. My first idea [1] was an open-source tool that lets you try different variations of prompts, but even though I used it endlessly for the first 5-ish days, I… never used it again.<p>I wrote other scripts, compiled personal eval sets, and subscribed (then unsubscribed) to a bunch of online tools. Nothing seemed right.<p>Until last Friday when, talking about side project ideas with my girlfriend, she said, “What if it was in your code editor?”<p>And I thought, wow, I love this woman.<p>This VSCode extension instead lets you highlight your prompt text and run it against any and all models [2]. You can toss in your API keys, which are only stored locally, and use it for free.<p>Any feedback would be invaluable - this is my first extension!<p>I’ll be adding the same highlighting functionality I have for prompts to schema validation, where you can highlight any form of schema (pydantic, zod, json), and I’ll use a small llm to parse it + format it for different providers.<p>[1] <a href="https://github.com/benguz/prompt-octopus">https://github.com/benguz/prompt-octopus</a>
[2] <a href="https://promptoctopus.com" rel="nofollow">https://promptoctopus.com</a>