GitHub incident: ongoing issues with Actions, Issues and other Git operations

I debugged for one min at 11:59 trying to push, and then my eat-lunch notification came in at 12:00 and I opened hackernews with a tuna sandwich and this is super helpful because it means I wont need to debug it locally for 10 mins before figuring out Github is down.<p>Edit - Just want to clarify when I say &quot;opened hackernews with a tuna sandwich&quot; I want to clear up that I did indeed full on mash the keyboard letters with my sandwich. It&#x27;s costing me a fortune in keyboards every day and it&#x27;s ruining my sandwich most days as well, I think I have an issue.

The GitHub Status shows 14 incidents affecting Git Operations this year alone [1]. That&#x27;s quite a lot, considering it&#x27;s only May. I wonder if the outages were always this frequent and just get more publicity on here now, or whether there was a significant increase in outages fairly recently.<p>[1] <a href="https:&#x2F;&#x2F;www.githubstatus.com&#x2F;history" rel="nofollow">https:&#x2F;&#x2F;www.githubstatus.com&#x2F;history</a>

Interested to hear whether anyone actually managed getting some Client Credits as per their SLA [1]? Over the last quarter they probably went sub 99.9% in some services.<p>[1] <a href="https:&#x2F;&#x2F;github.com&#x2F;customer-terms&#x2F;github-online-services-sla">https:&#x2F;&#x2F;github.com&#x2F;customer-terms&#x2F;github-online-services-sla</a>

Does GitHub provide uptime stats? Seems very unreliable recently.

Once again another GitHub incident and 4 days later before the last one [0], GitHub Actions goes down.<p>You are better off self-hosting at this point, rather than centralizing everything to GitHub [1] as it is just chronically unreliable for years ever since the Microsoft acquisition.<p>[0] <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=35817998" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=35817998</a><p>[1] <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=22867803" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=22867803</a>

Rumor has it Microsoft is pushing them to move their infrastructure to Azure, which explains much of the frequent downtimes lately.

Really looking forward to kicking the tires on Gitea next month.

Great to be here. Next week same time?

Been off work for a month-ish. Everything is as it was I see.

I&#x27;m the lone person at my team that still believes in keeping most of our stuff local, with online versions as primarily backup.<p>Every time some global service goes down, or internal internet&#x2F;intranet goes down, there is a security breach, or a WFH person has a power outage I&#x27;m reminded I&#x27;m right.<p>I&#x27;m no luddite, these services make you dependent on them. The worst thing I&#x27;m dependent on here is a bad computer. We have backups and keep our files on our network, so it seems fine. We are slowly moving to an online system, and I&#x27;m constantly reminded all the problems shifting online.<p>Meanwhile, if I had a linux server, we would be in control of our own destiny.

Perhaps everyone should stop complaining and be thankful for a chill morning. You can&#x27;t create a PR right now - go get a pastry and some fresh air. Be in the moment for once. It&#x27;s beautiful outside*<p>* Where I am

Why don&#x27;t we all collectively mirror our repos to gitlab and switch development to there during the monthly outage?

From the outside, it appears GitHub doesn&#x27;t have any internal sharding going on. Outages always affect _all_ repos.<p>Architecturally this seems rather sub optimal?<p>EG AWS doesn&#x27;t roll out changes globally - they start with an internal shard within a region and progressively roll out to more shards and more regions.<p>Why do GitHub not do the same?

You will probably notice it also when trying to push a new branch:<p>`error: failed to push some refs to ` when using --set-upstream

&quot;Actions, Issues&quot; are not &quot;Git operations&quot;.<p>would sound better without &quot;other&quot; in title

If that makes you mad, I still need help with <a href="https:&#x2F;&#x2F;github.com&#x2F;MichaelMure&#x2F;git-bug">https:&#x2F;&#x2F;github.com&#x2F;MichaelMure&#x2F;git-bug</a> ;-) Coming at some point, kanban and pull-request support, offline-first!

Hm, we had this last week as well. Guess who had a demo yesterday, needed to deploy things on Thursday&#x2F;Friday and couldn&#x27;t :(

Can anyone from GH weigh in on this? We&#x27;ve had several major outages from GH over the last month or two, and the company has been completely silent on the causes, as well as any sort of remediation steps to fix stability.<p>As a somewhat large size org, we&#x27;re now exploring other options for code hosting.

Was unable to merge PRs.<p>Earlier, I also got GitHub PR comment emails about 6 hours late.<p>Whatever it is, it’s been happening for more than 6 hours.

Thankfully git is a distributed version control system, so such outages are not of major concern.

They are adding affected services to the status entry title (started with Issues, Actions, Operations). Can&#x27;t even do a simple push due to this so-called &quot;degraded performance&quot;.

They’ve convinced me to shut off the GitHub status alerts I get on slack (or at least move them to their own channel that I can ignore).

CivitAI.com is down and Hugging Face is having 502s for some operations. Perhaps there is a larger issue?

Wondered why I couldn&#x27;t push my notes, appears that pushing commits is also impacted.

Ever since Microsoft acquisition

This is a monthly incident at this point. Maybe they have a rogue cron job??

i wonder if all these incidents are related to azure devops integration

This happens constantly, what is the Github team doing?

I haven&#x27;t been able to push for a bit now

&quot;We gave ChatGPT root access to our infrastructure servers, and unexpectedly it crashed everything.&quot;<p>That&#x27;s <i>almost</i> believable at this point. ;)

2 hours going strong!

Having issues with `git push` from The Netherlands. :(

Cannot create a new repo

Now pages too

Again?