TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Open source inference time compute example from HuggingFace

88 pointsby burningion5 months ago

5 comments

srush5 months ago
Full blog is here: <a href="https:&#x2F;&#x2F;huggingface.co&#x2F;spaces&#x2F;HuggingFaceH4&#x2F;blogpost-scaling-test-time-compute" rel="nofollow">https:&#x2F;&#x2F;huggingface.co&#x2F;spaces&#x2F;HuggingFaceH4&#x2F;blogpost-scaling...</a><p>Happy to answer any questions about these methods.
评论 #42471166 未加载
评论 #42487668 未加载
评论 #42474566 未加载
评论 #42471138 未加载
mentalgear5 months ago
Happy to see &quot;inference time compute&quot; term being used primarily nowadays - it&#x27;s a much more precise and appropriate term compared to the unwieldy &quot;test-time compute&quot; that openai used to call it when they thought they &quot;invented&quot; scaling inference time.
emmelaich5 months ago
The linked &quot;bitter lesson&quot; paper by Rich Sutton is so good!<p><a href="http:&#x2F;&#x2F;www.incompleteideas.net&#x2F;IncIdeas&#x2F;BitterLesson.html" rel="nofollow">http:&#x2F;&#x2F;www.incompleteideas.net&#x2F;IncIdeas&#x2F;BitterLesson.html</a>
boroboro45 months ago
What&#x27;s a point of such inference time compute if verifier is 8B model itself? Am I missing something?
评论 #42475331 未加载
bilsbie5 months ago
Eli5?
评论 #42471216 未加载
评论 #42475372 未加载
评论 #42471366 未加载