Show HN: AI Proxy with Support for OpenAI, Anthropic, LLaMa2, Mistral

I prefer something open source. If the idea is to reduce dependencies on services. It is not against paying, but more against taking on another corporate dependency.

from first glance, it looks similar to LiteLLM[0]. Are there any key differences?<p>Also, in light of this weekend&#x27;s madness, are you reconsidering using the OpenAI API as the canonical interface? Do you think there could be changes in the future?<p>[0] <a href="https:&#x2F;&#x2F;github.com&#x2F;BerriAI&#x2F;litellm">https:&#x2F;&#x2F;github.com&#x2F;BerriAI&#x2F;litellm</a>

We&#x27;ve been using Braintrust for evals at Zapier and it&#x27;s been really great -- pumped to try out this proxy (which should be able to replace some custom code we&#x27;ve written internally for the same purpose!).

This looks great! The interface is really simple and I love that I can abstract away LLM provider concerns. I could see how this could be a nice play to overcome reliability issues with LLM providers.

I&#x27;ve been thinking that with OpenAI introducing more and more workflow there will be a company that turns opensource model to API + workflow. I&#x27;m wondering if Braintrust vision is that?

Do you have plans to support Bedeock? In a hosted environment, I recognize it&#x27;s a little more...involved. But still, I&#x27;m curious.

Very timely release in terms of interoperability. Auto caching seems like a no-brainer too. Nice job team for shipping this past weekend

This is neat. It is more obvious than ever that everyone should be building in redundancy, testing across models.

this is great. redundancy across models (closed and open-source) seems like an obvious need, esp in light of everything this weekend

how does this differ from a model “router” (e.g. withmartian.com)?

where is the github?