TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Inference.net: Wholesale LLM Tokens

5 pointsby funfunfunction9 months ago

1 comment

padolsey9 months ago
Looks cool. To help the pitch, I think you should show the equiv price on anyscale/together for the 10B tokens. Also is there a reason you're not selling at more granular amounts? Why $400? Just speaking personally, I reckon I'd rather invest in a 3090 so I have more security/privacy. I can't think of many genuinely _useful_ 10B+ uses that won't include a bunch of private data. But nonetheless, I reckon there's a niche here, so nice work.
评论 #41241921 未加载