Best explanation I found was this video: <a href="https://www.youtube.com/watch?v=WiBB8Lsgl7I" rel="nofollow">https://www.youtube.com/watch?v=WiBB8Lsgl7I</a><p>It's three things, all currently waitlisted:<p>1. A new model playground (like the ones by OpenAI and Anthropic) that lets you try prompts against a large range of models<p>2. Client libraries for the same using what looks like a universal API proxy, though I think these are existing Azure libraries<p>3. A "gh models run" command (similar to my LLM CLI tool) that lets to interact with models on the command line<p>So it's mostly a wrapper around existing Azure stuff that makes it MUCH easier to use, because GitHub are better than Azure at things like authentication systems that don't strike fear into your mortal soul.
Seems like this is a sales funnel for Azures OpenAI/LLM gateway with GitHub as a proxy(?). It's a bit unclear. Regardless, I'd be pretty wary of adding either Azure or GitHub as a core dependency to any of my apps at this point with how poor uptime seems to be at both lately.<p>Also, the pricing is pretty shady. It seems like your GitHub PAT gives you free limited access, but if you ever want to move to a paid model, you have to transition to Azure. The shady part is that it's pretty hidden. You have to go to a specific model in the Marketplace, (for example: <a href="https://github.com/marketplace/models/azureml-mistral/Mistral-large">https://github.com/marketplace/models/azureml-mistral/Mistra...</a>), then go to the bottom of the "Chapters" to the "Going beyond rate limits" section. There it just directs you straight to the Azure portal.
I'm not sure what the point of this is. Aren't there enough LLM playgrounds out there?<p>Maybe if they wanted to develop it into a useful feature it would create unique LLM benchmarks from your pull requests and issues, so you can easily test which model performs best on your codebase. Then augment that with fine-tuning to your code style, etc.
<i>"We believe every developer can be an AI engineer with the right tools and training [...] GitHub is the creator network for the age of AI. [...] Just in the last year, more than 100K generative AI projects were created on GitHub. [...] In the years ahead, we will continue to democratize access to AI technologies to generate a groundswell of one billion developers."</i><p>If I've learned one thing in the software industry, then that with a sufficiently creative definition of the word 'engineer' everything is possible. It feels like every week the AI "industry" turns more into some sort of cursed influencer economy. I guess if you've got to explain to your shareholders how you're gonna make the 10 billion back you spent on graphics cards you gotta be optimistic.
GitHub has been running too many waitlist scams lately. Why do they need a waitlist for this? Waitlists are a scam because I'm already waiting to be approved for my last waitlist application from several months ago. Fool me once.
> One data pack costs $5 per month, and provides a monthly quota of 50 GiB for bandwidth and 50 GiB for storage. You can purchase as many data packs as you need. For example, if you need 150 GB of storage, you'd buy three data packs.<p>They really need to move on from this pricing structure. It's too expensive to host and distribute large binary files from GitHub.