TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Show HN: Visualize OpenAI Evals of GPT-4

1 pointsby confutioabout 2 years ago
OpenAI&#x27;s new evals library (<a href="https:&#x2F;&#x2F;github.com&#x2F;zeno-ml&#x2F;zeno-evals">https:&#x2F;&#x2F;github.com&#x2F;zeno-ml&#x2F;zeno-evals</a>) makes it easy to create and run evaluations to find the limitations of GPT-4.<p>The CLI library just prints out an overall metric after the process has finished, and doesn&#x27;t give you any insights into what types of outputs and failures GPT-4 produced.<p>This simple one-line command lets you pass in the log outputs from Open AI evals (<a href="https:&#x2F;&#x2F;github.com&#x2F;openai&#x2F;evals&#x2F;">https:&#x2F;&#x2F;github.com&#x2F;openai&#x2F;evals&#x2F;</a>) and interactively explore the actual generated data!<p>Try it out with `pip install zeno-evals`

no comments

no comments