TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

ChatGPT costs 700k/day to run; may go bankrupt in 2024

22 pointsby nycdatascialmost 2 years ago

15 comments

smcleodalmost 2 years ago
Honestly if you can get yourself a video card with at least 12gb of RAM and I highly recommend running open source models locally.<p>It doesn’t have to be the latest fancy gaming card - I run an old 2016 Tesla P100 ($200AUD~) which is fine for 16B q4 models.<p>They’re more configurable, there’s no subscription model, you contribute to them and meaningful ways, there is a privacy concern if you’re passing your own data and it’s perhaps strangely a more fulfilling experience.<p>I’ve got mine hooked up to Home Assistant so I can automate things with Siri and shortcuts, I’m using it finding patterns and code and several decades of digital notes.<p>If you’re not sure where to start, you can try some models out locally on your machine, using apps like <a href="https:&#x2F;&#x2F;lmstudio.ai" rel="nofollow noreferrer">https:&#x2F;&#x2F;lmstudio.ai</a> or GPT4All with almost no ML knowledge. Then if you want to level up and customise things and run them on the server you can use localAI, Text generation web UI etc which provide openAI compatible APIs.<p>A good 13B model with decent prompting feels pretty on par with chatGPT (3.5) for general tasks, but can be configured to be quite good at very specific things.<p><a href="https:&#x2F;&#x2F;github.com&#x2F;oobabooga&#x2F;text-generation-webui">https:&#x2F;&#x2F;github.com&#x2F;oobabooga&#x2F;text-generation-webui</a><p><a href="https:&#x2F;&#x2F;github.com&#x2F;go-skynet&#x2F;LocalAI">https:&#x2F;&#x2F;github.com&#x2F;go-skynet&#x2F;LocalAI</a><p><a href="https:&#x2F;&#x2F;github.com&#x2F;gitmylo&#x2F;audio-webui">https:&#x2F;&#x2F;github.com&#x2F;gitmylo&#x2F;audio-webui</a>
评论 #37120386 未加载
notpushkinalmost 2 years ago
&gt; Don’t miss out on the latest developments in business and finance. Let us notify you as they happen.<p><i>press “I&#x27;m in”, just to mess around</i><p>&gt; Push Notifications are available for only chrome browser right now. You will be redirected to home page in few seconds.<p>This is some advanced level of bullshit.
评论 #37120306 未加载
sigmoid10almost 2 years ago
*Could* cost *up to* $700k&#x2F;day *according to an outsider analyst*<p>Also, nowhere did the original source say that this would lead to bankruptcy. This article is bs.
bhaneyalmost 2 years ago
By this logic, Uber should have gone bankrupt &gt;5 times by now
Gysalmost 2 years ago
Discussed (and flagged) yesterday: <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=37109394">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=37109394</a>
invalidnamealmost 2 years ago
This sounds like BS. Lets assume investor money covered the R&amp;D costs and assume all other numbers are correct. 10Bn dollars would be enough for 31 years of 700kUSD spend every day...<p>This ignores the fact that quite a lot of people pay for ChatGPT pro. That might not cover the costs but I&#x27;m sure their burn rate won&#x27;t expire soon. 10Bn is a LOT of money.
fendy3002almost 2 years ago
Is it that expensive, unoptimized due to very early or the costs are also include the training for new model?<p>Wonder what&#x27;ll be the minimum future cost when it&#x27;s already optimized and used for self hosted commercial purpose.
sharemywinalmost 2 years ago
First off it would never just go bankrupt just for the reason it would be one hell of an acquihire. let alone someone would pay for the ChatGPT tech.<p>I doubt they have alot of actual debt.<p>they have paid users. People pay to use the API.<p>I think ChatGPT was an accident and was rally intended to be a &quot;demo&quot;<p>If chatGPT can&#x27;t raise more money then no one can. You&#x27;d be crazy not to make a 1-5% of your wealth bet on GPT5.<p>if they went public today I would invest in them before anything else. I would argue a big part of microsofts recent bump is stock market access to chatgpt.
评论 #37140229 未加载
dumpsterdiveralmost 2 years ago
The world will not stand for losing the newly gained capabilities of ChatGPT and the like. The fact that it costs $700k a day to run shows that there is still a very high cost of entering the space, and so the incumbent players have the advantage.<p>There are serious military advantages to having access to a machine learning model this advanced. Not only propaganda, but actual war planning. The only thing that&#x27;s going to close this box is world war, or a catastrophic natural event.
评论 #37120496 未加载
zhiQalmost 2 years ago
“If the company has 100 million users as it has claimed, and converted 1 percent of them to paying customers, that’s good enough to put them on a $200 million plus run rate.” <a href="https:&#x2F;&#x2F;twitter.com&#x2F;om&#x2F;status&#x2F;1690903567551586304?s=20" rel="nofollow noreferrer">https:&#x2F;&#x2F;twitter.com&#x2F;om&#x2F;status&#x2F;1690903567551586304?s=20</a>
jhoelzelalmost 2 years ago
Azure is pretty much only starting to sell the models soooo i suspect this might change very soon
izzydataalmost 2 years ago
Very clever. Get everyone hooked on a free ChatGPt and then fail to monetize it and go bankrupt.
chrisgdalmost 2 years ago
This article doesn’t understand an income statement or balance sheet.
ChatGTPalmost 2 years ago
Flagged for...?
评论 #37120423 未加载
评论 #37120553 未加载
pyluaalmost 2 years ago
It bothers me that Sam Altman may become rich even if his company goes bankrupt. Something does not feel right about that — or am I wrong ?
评论 #37120309 未加载
评论 #37120304 未加载
评论 #37120290 未加载
评论 #37120329 未加载
评论 #37120301 未加载