GitHub Is Down

[japhyr]

There's a not-entirely-small part of me that hopes Issues breaks entirely for long enough that people at GitHub rethink their implementation.

GH issues have been so useful for the better part of a decade, that I have an empty repo called my_life just so I can make issues about things like home maintenance. In the last few months, the UI has become so slow and flaky that I don't use it for nearly as much as I used to. And when I have to for a project, it slows me down noticeably.

I thought I was alone in this, but asking around I found that this is a common frustration among developers I communicate regularly with.

[simonw]

I do the same - I've been running so many non-software things out of private GitHub Issues. I even have a simple system for creating a new issue every day to use as a personal TODO list, described here: https://til.simonwillison.net/github-actions/daily-planner

I've noticed everything feeling a whole lot less snappy and responsive over the past few days - ironically I think it's because they've done a major rewrite of the frontend presumably with the aim of making it more snappy and responsive!

[PapaPalpatine]

I’m low-key certain it’s because they started using more React on the front end, especially for the new Issue stuff. The entire UI feels slow and janky like GitLab.

[straws]

You're not alone. There's been an effort to transparently update the UI to a React implementation over the past year or two, and while I understand the benefits to that approach, they have introduced some flakiness in moving away from a the server-rendered pjax/html-pipeline/simple web components approach that was so cohesive and battle tested over the decade before it.

[jrochkind1]

I am not experiencing a full outage right now, but I am experiencing very slow (spinner) and flakey (error that works again on repeat).

So perhaps it's the same problem, that's been getting more prevalent until it was noticeable by monitoring. One can hope!

[RohMin]

That's actually a really interesting way to leverage that feature. Have you found this easier than other services built specifically for this use case?

[joseda-hg]

For something so critical, does it make sense to self host say a gitea instance or such?

I know you can sync repos, I don't think you can sync issues tho

[bigfatfrock]

Who's going to kick off the holy war around self hosting?

[reddalo]

Speaking of self hosting, Codeberg [1] is great. It's open and it looks and behaves pretty much like GitHub (unlike GitLab).

[1] https://codeberg.org/

[otter-in-a-suit]

Since you asked, https://about.gitea.com/ is a great tool. MIT license.

[skydhash]

Personal projects are on a vps and accessed through ssh. I’ve self-hosted gitea, then forgejo, then found out that I don’t like the interface or the auth dance. My plan is to ise cgit if I want something to be public and any forge if the purpose is collaboration (sourcehut is nice)

[duxup]

Honestly, sounds like a lot of work and I'm not sure I get much benefit, or even less downtime.

I don't know about others but for me github is hardly a service that I'm sweating moment to moment uptime. My apps are still running and so on.

[cropcirclbureau]

Hosting GitLab is not fun but anyways, M$ can still suck it.

[rvz]

It all began 5 years ago [0] when we wanted to 'centralize everything to GitHub.'

Then, the outages accelerated from there.

[0] https://news.ycombinator.com/item?id=22868406

[peterldowns]

I'm seeing issues with repo pages entirely (getting Unicorn "We couldn't respond to your request in time" errors) but the status page hasn't updated to show that yet.

[cjonas]

Bitbucket was down for a few hours a week ago and 0 fuss was made about it in the media. Atlassian stock actually went up over the ourage

[diggan]

Besides projects/companies/people stuck on Bitbucket, is anyone actually voluntary using Bitbucket? I remember using it back when I was poor and it was the only choice for hosted free private repositories, but the rest of the platform was actively worse in basically every way compared to the alternatives.

[jeffbee]

Because literally nobody uses it.

[crest]

Pun intended?

[rvz]

This continues to be a regular thing for the past 5 years of outages and I've lost count of the many outages that GitHub continues to have since calling it. [0]

[0] https://news.ycombinator.com/item?id=22868406

[G1N]

They're saying PRs and issues but I can't access github.com or github oauth for logging into external services. Need to migrate our org off of using github auth for anything critical I think, this is twice so far this year that we've had these issues.

[lawrjone]

The industry made a general decision after ZIRP ended to deprioritise availability after years of historic levels of engineering investment.

It's no surprise we're now feeling those effects but damn, GitHub and other services like Slack have been really bad lately.

[diggan]

Or, GitHub used to favor stability back in the day, and there wasn't a lot of changes. People were complaining that GitHub didn't "improve" enough day-to-day, so after the Microsoft purchase, Microsoft started forcing GitHub to add more features, stability be damned.

Most outages are caused not by stuff just randomly breaking, but updates/upgrades going wrong. If you try to increase the output of new features/changes to a platform, you're bound to have more outages and downtime if you aren't more careful than before.

Microsoft, who never really excelled at engineering, to the surprise of absolutely everyone, choose adding features over stability and since years back, we're seeing the consequences of that choice.

[rohansingh]

GitHub's reliability has gotten pretty terrible since the Microsoft acquisition, well before ZIRP ended.

[NewJazz]

Citation needed?

Is this true beyond github and slack? Both were acquired btw, that could explain their availability issues (just like twitter, now X).

What about e.g. AWS or GCP? Has their availability meaningfully reduced?

[brunocroh]

If I'm not wrong, this is the third week in a row with GitHub incidents, isn't it?

[floydian10]

The incidents history page is really damning. I didn't realize it gotten so bad

[ChrisArchitect]

Direct incident link: https://www.githubstatus.com/incidents/nm83zrdky73y

[hedora]

The last few days, the “create pr” screen kept hanging for me. I figured out I could reload it, click “create”, grab a coffee, and then come back and it’d be at the next screen.

Maybe it’s time to learn their CLI (and then patiently wait for work to switch to another git service).

[ferriswil]

Maybe we can spend this downtime researching self-hosting options

[shafyy]

I feel like it's not only GitHub... Slack is very slow, too.

[smitelli]

I've been getting a couple generic Cloudflare 521 responses across a weird mix of big and not-big sites this morning. Things have felt a little off.

[xenospn]

It was me. Sorry. I just merged a PR and down it went :/

[adhamsalama]

Why don't they make the AI fix it? Are they stupid?

[tovej]

It's not just PRs and issues, my build systems are breaking because I can't download tarballs for dependencies from github.

[flyinghamster]

One thing I started doing a few years ago is that, any time I check out a git repo, whether it's on github or anywhere else, is clone it to my NAS and then clone from there to whatever I'm building it on. Aside from guarding against losing dependencies to outages (or from being yanked), it can be handy for guarding against my own fat fingers, and for making sure that the same version is running on multiple systems.

[dexcs]

I think that's deepseek striking back.

[khaledh]

Everything is slow. It takes several seconds to load any page, submit a comment, etc.

[upheaval7276]

I honestly can't believe how unreliable Github is. Outages are commonplace. It boggles my mind how nothing has been done to address the reliability regressions that have been creeping in ever since MS took over.

[kalleboo]

Seems like it's back for me (and slow.. and now down again)