TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Knuth Optimystic Benchmark

2 pointsby heyzkalmost 2 years ago

1 comment

heyzkalmost 2 years ago
Hey all, I found the post about Don Knuth and ChatGPT [1] very interesting so I hacked together this project over the weekend. Optimystic periodically re-runs Knuth&#x27;s questions against the latest GPT model (additionally I&#x27;ve asked GPT to score the updated answers as PASS&#x2F;FAIL).<p>Initially I thought it would just be a fun thing, but I&#x27;ve realized there could be some value to the larger LLM community. Also I think it would be interesting to apply this format to experts in other fields.<p>Appreciate any feedback.<p>[1] <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=36012360" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=36012360</a>