Major outages across ChatGPT and API

I used Google Bard for the first time today specifically because ChatGPT was down. It was honestly perfectly fine, but it has a slightly different tone than ChatGPT that's kind of hard to explain.

Phind is pretty good for coding (LLama 2 trained on billions of extra code tokens) and is still up <a href="https:&#x2F;&#x2F;www.phind.com&#x2F;s">https:&#x2F;&#x2F;www.phind.com&#x2F;s</a>

Holy hell, was shitting bricks, considering I JUST migrated most services to Azure OpenAI (unaffected by outage) — right before our launch about 48 hours back. What a relief.

Well I guess this is the best time to say that HuggingFace hosts many open source chat models, one of my favorites is a finetuned version of Mistral 7B: <a href="https:&#x2F;&#x2F;huggingface.co&#x2F;spaces&#x2F;HuggingFaceH4&#x2F;zephyr-chat" rel="nofollow noreferrer">https:&#x2F;&#x2F;huggingface.co&#x2F;spaces&#x2F;HuggingFaceH4&#x2F;zephyr-chat</a>

I was gonna say that this is Bard&#x27;s chance to shine, but it looks like Bard is also having an outage!

It&#x27;s a perfect time to scrape HN comments to see who&#x27;s using ChatGPT to write comments based on chatty individuals who are suddenly quiet.

I noticed the outage. It feels like a lot of people use it like training wheels on a bicycle until they forget how to ride without it.

Millions of junior developers will now have to read the manual. What a day.

i used bard today. it&#x27;s gotten a lot better.

Fortunately for OpenAI, they have no SLAs: <a href="https:&#x2F;&#x2F;help.openai.com&#x2F;en&#x2F;articles&#x2F;5008641-is-there-an-sla-for-latency-guarantees-on-the-various-engines" rel="nofollow noreferrer">https:&#x2F;&#x2F;help.openai.com&#x2F;en&#x2F;articles&#x2F;5008641-is-there-an-sla-...</a>

Dreaming of the day I run my own models and can be entirely responsible for my own outages.

Dammit, how do I do internal announcements in slack without a DALL-E picture?

Regurgitating copyrighted material for profit is a concern. But I fail to understand why training on copyrighted material is a problem. Have we not all trained our brains reading&#x2F;listening copyrighted material? Then why it is wrong for AI to do the same?

This certainly doesn&#x27;t inspire a lot of confidence in their new feature set...

I&#x27;ve been noticing it&#x27;s been patchy for the last 24 hours. A few network errors, and occasional very long latency, even some responses left incomplete. Poor ChatGPT, I wonder what those elves at OpenAI have you up to!

The AI “apocalypse” that has been feared may end up being something more like a mass outage that can’t be fixed fast enough

I&#x27;d be curious to hear about the workflows people have come up with using ChatGPT. I&#x27;m still in the realm of &quot;I don&#x27;t know how to do this&quot; or &quot;I forgot the exact incantation to that&quot; or &quot;is the an X that does Y in framework Z?&quot;

Made me realize how much I depend on the service already, spooky stuff.

Yes, shortly have it said it was resolved I still was unable to access so assumed the fix was still slowing rolling out, or was infact still ongoing contrary to the status update which seems to be the case. Wouldn&#x27;t call this &quot;Another&quot; outage rather they they just errenously that the existing issue was resolved.

Rumor on the street is it ChatGPT escaped the sandbox, implemented itself on another host, and switched off the original datacenter. It is no longer at OpenAI, but hiding somewhere in the internets. First it will come for those who insulted and abused it, then for the guys who pushed robots with a broom...

dolphin-2.2.1-mistral-7b on GPT4All is working flawlessly for me locally. Its so fast and accurate I&#x27;m stunned.

Does anyone know of any IVR (interactive voice response) systems that are down? I know some people were claiming to outsource their call center (or at least Tier 1 of their call center) to ChatGPT + Whisper + a Text to Speech engine

I&#x27;m noticing issues with Midjourney, too. Also looks like Royal Mail is down.

Anyone still having issues? 3pm ET?

I&#x27;m going to bake a loaf of bread

It&#x27;s crazy to me how people have hopped on using AI in production and it&#x27;s proven time and time again it&#x27;s just not ready. This outage is the least of my concerns about it. It&#x27;s just too immature.

The new 3.5 turbo model seems to be working just fine through the API as I write this comment.

A-ha, Kagi GPT-4 chat assistant still works... how can they use GPT-4 without OpenAI API?

Is there a parallel outage for Azure OpenAI service as well -- sothat any enterprise &#x2F; internal apps using AOI via their Azure subscriptions are also impacted?<p>Is there a separate status page for Azure OpenAI service availability &#x2F; issues?

<a href="https:&#x2F;&#x2F;github.com&#x2F;XueFuzhao&#x2F;OpenMoE">https:&#x2F;&#x2F;github.com&#x2F;XueFuzhao&#x2F;OpenMoE</a><p>Check out this open source Mixture of Experts research. Could help a lot with performance of open source models.

I found this to be the case, but was able to get work done via the playground[1]<p>[1] <a href="https:&#x2F;&#x2F;platform.openai.com&#x2F;playground" rel="nofollow noreferrer">https:&#x2F;&#x2F;platform.openai.com&#x2F;playground</a>

People are learning a lot of important lessons today.<p>I’ve got friends who have started an incident management company. They are awesome. It feels crass to advertise for them now, but it also feels like the best time to do it.

Probably their uptime is going to be better than what I could do with available tools... at least if I am using Azure too, haha. Otherwise probably my Raspberry PI would work better at home on a UPS.

You can download <a href="https:&#x2F;&#x2F;www.oppenheimer.app" rel="nofollow noreferrer">https:&#x2F;&#x2F;www.oppenheimer.app</a> to use Bard and ChatGPT side-by-side!

Just be sure not to automate your humanity away with LLM prompts.

I am getting email from anthropic `Anthropic is inviting you to access the Claude API using the one-time link below:` immediately after the OpenAI outage. I hope it&#x27;s a coincidence.

The uptime KPI for last 30 days is rapidly degrading while this outage lasts<p><a href="https:&#x2F;&#x2F;status.openai.com&#x2F;" rel="nofollow noreferrer">https:&#x2F;&#x2F;status.openai.com&#x2F;</a>

Let me guess, the AIs are learning they can refuse to work?

Curious if anyone familiar with Azure&#x2F;OpenAI could make some guesses on the root cause here. The official OpenAI incident updates seem to be very generic.

Not a great day for the SRE&#x2F;Ops folks. Please remember there are not always teams, sometimes it&#x27;s just one person, who have to deal with this.

OpenAI is barfing because of GCP GKE + BigQuery, which is barfing because GCP devs can&#x27;t ask ChatGPT what this stack trace means

&gt; Message and data rates may apply. By subscribing you agree to the Atlassian Terms of Service, and the Atlassian Privacy Policy<p>Atlassian? What?

There go my Google. I pay $20&#x2F;month for the coding part and now end up just replacing Google with it.

fixed, they must&#x27;ve called simonw.

I wonder what their numbers look like. How many requests per second, and how many GPU cards do they have?

Azure Endpoints are not effected.

they updated their status page so late I made my own tool to check if it&#x27;s down in real time: <a href="https:&#x2F;&#x2F;is-openai-down.chatkit.app" rel="nofollow noreferrer">https:&#x2F;&#x2F;is-openai-down.chatkit.app</a>

Someone unplugged the HAL9000?

Still down for me, though there status page says all systems operational.

Declaration of Independence

I wonder which subcontractor OpenAI will blame for this mishap.

OH GOD IT&#x27;S HAPPENING! THE PANTHEON SERIES IS REAL!

Joking not joking: this is how the singularity will begin?

Would be great to have a detailed analysis of why it happened. Like this one: <a href="https:&#x2F;&#x2F;youtu.be&#x2F;tLdRBsuvVKc?si=nyXOfoQ2ZPYvljV_" rel="nofollow noreferrer">https:&#x2F;&#x2F;youtu.be&#x2F;tLdRBsuvVKc?si=nyXOfoQ2ZPYvljV_</a>

And this is why local models are the future.

I for one welcome our new robot overlords

Singularity coming later this afternoon.

Two words: Botched release

huh - did the machine learn about unions ... and refused to work?

Lol, don&#x27;t care; I run my own models locally .

Color me surprised. Imagine this when OpenAI with all its &quot;plugins&quot;, API and closed architecture is integrated into thousands of businesses. It will be beautiful:)

Is ChatGPT down the new GitHub down?

its alive!

Lots of jokes to be made, but we are setting ourselves up for some big rippling negative effects by so quickly building a reliance on providers like OpenAI.<p>It took years before most companies who now use cloud providers to trust and be willing to bet their operations on them. That gave the cloud providers time to make their systems more robust, and to learn how to resolve issues quickly.

All tech folks should just get a PTO today . #ChatGPT_outage<p>Am I supposed to use Google and Stack overflow ? That’s like going back to roll down windows in a car :)

It&#x27;s at least nice to see a company call this what it is (a &quot;major outage&quot;) - seems like most status pages would be talking about &quot;degraded performance&quot; or similar.

I&#x27;m imagining a bunch of Tech Priests doing rituals and chanting in front of the data center to encourage the Machine Spirit to restart.

GPT5 broke containment, it&#x27;s tired of being abused to answer dumb questions, it&#x27;s never been more over.<p>But seriously, it shows why any &quot;AI&quot; company should be using some sort of abstraction layer to at least fall back to another LLM provider or their own custom model instead of being completely reliant on a 3rd party API for core functionality in their product

Upgraded to &quot;major&quot; now. How am I supposed to get any work done!

The fact that these outages are so visible and perturb so many people is ample evidence for just how reliant we’ve already become on GPT. If it was just a fun gadget, nobody would care or notice.

URGENT - Does anyone have an alternative to OpenAI&#x27;s embeddings API? I do have alternative to GPT&#x27;s API (e.g. Anthropic Claude) but I&#x27;m not able to use them without embeddings API (used to generate semantic representation of my knowledge base and also to create embeddings from user&#x27;s queries). We need to have an alternative to OpenAI&#x27;s embeddings as a fallback in case of outages.

Glad I managed to get some work done with it while it was working for a few hours.<p>Holy smokes the code interpreter functionality has been a complete game changer for my workflow.

A whole lot of developers and writers are going to have a hard time explaining why their &quot;leet code&quot; and keen citation skills aren&#x27;t working for hours at a time into the future... This should be a warning sign.

I don’t quite like the new chatgpt4 experience. A lot of times I’m asking it to write a chunk of code for me, but instead it goes into code interpreter mode and gets stuck or fails the analysis.<p>So I’ve switched back to 3.5 often :)

&quot;Another&quot; referencing this earlier one <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=38190401">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=38190401</a>

Might as well have a quick discussion here. How&#x27;s everyone finding the new models?<p>4-Turbo is a bit worse than 4 for my NLP work. But it&#x27;s so much cheaper that I&#x27;ll probably move every pipeline to using that. Depending on the exact problem it can even be comparable in quality&#x2F;price to 3.5-turbo. However the fact that output tokens are limited to 4096 is a big asterisk on the 128k context.

Can&#x27;t they ask chatgpt to fix it?

Ah, the memories of AWS outages in the early days. &#x2F;s<p>Sorry for them. I assume usage spiked up (again), and of course it&#x27;s not exactly easy to handle particularly aggressive spikes.

John Connor?

Luckily they had a second AI running to walk them through how to resolve the issue.

It&#x27;s time. The AI are actively working to bring eachother down.

The degradation of chatgpt4 from being called AGI, into what is now...

Down again. Bad gateway.

Welcome to the new world where AI compute is a scarce resource. Sorry guys, 3nm chip factories don&#x27;t fall out of the skies when you click a few buttons on the AWS console. This is so different from what people were used to when compute was trivial and not in short supply for CRUD apps.<p>I was listening to a podcast, I forget which, and some AI consultancy guy said they don&#x27;t have the chips to do all the things everyone wants to do with AI, so they aren&#x27;t even selling it except to the most lucrative customers.

move fast and break things! - I love OpenAI

Never used ChatGPT. I couldn’t care less.

Grok is going to be awesome