TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Show HN: Model Gateway and LLM Guardrails with OpenAI SDK

3 点作者 veryrealsid8 个月前
Hello Hacker News!<p>We&#x27;ve updated our model gateway + guardrail tool called `optimodel` to use the on the OpenAI SDK primarily on the client side.<p>Now with a few lines changed you can instantly get access to 25+ model along with LLM guardrails like Llama prompt guard or Microsofts PII guard. All with the same OpenAI interface, no changes to your code.<p>We hope this will make it easier for developers to try out new models with ease along with setting up LLM guardrails with little changes to your code<p>We also have some fun features like fallback support to defer to other models if a provider is down, speed priority to choose the provider thats the cheapest regardless of speed, and more!<p>We&#x27;d love feedback on this to see if it can help others!<p>You can find the project here: <a href="https:&#x2F;&#x2F;github.com&#x2F;Lytix-Labs&#x2F;optimodel&#x2F;tree&#x2F;master">https:&#x2F;&#x2F;github.com&#x2F;Lytix-Labs&#x2F;optimodel&#x2F;tree&#x2F;master</a>

暂无评论

暂无评论