- Still independently owned. Imagine AWS or Microsoft buying it. Oof.
I think about LinkedIn, Github, ... the other large platforms we use for work, and SE is the only one that hasn't gone downhill.
No, I don't want them to open source the platform. No, I don't think you can do better. Yes, a few mirrors for redundancy would be excellent, but not urgent. Discoverability here would be the challenge for mirrors. They've been down less than a day total for me in 10+ years of using them.
And this is at least the 4th or 5th time within 10 days that either the website is down or performance is badly degraded.
So bad for a website that is basically the go-to resource where IT professionals get their answers.
So bad that the whole platform is closed-source, so we can't even spin multiple instances.
The main resource used by developers and sysadmins around the world is locked and centralized, and when that central place goes down all the answers go down with it.
We need crawlers and scrapers to download EVERYTHING out of the SE platforms, and they need to do so on a daily basis. All content on SE must be mirrored across the world, and if they don't want to do it then we'll do the scraping for them.
And, most of all, we need alternatives that are open and decentralized, and we need them right now.
> We need crawlers and scrapers to download EVERYTHING out of the SE platforms, and they need to do so on a daily basis. All content on SE must be mirrored across the world, and if they don't want to do it then we'll do the scraping for them.
I think that's already the case. Whenever I look up a technical issue, the first result is usually from SO; the next results are usually from websites that copied that first SO page
If you use brave browser it usually is able to point you to corresponding web archive pages when SO is down. Nice to have it directly integrated into the browser
For anyone looking on this from the future, the error page has Content-Type set to text/html but literally returns the text: "The service is unavailable." and a newline character.
Time to take a long lunch. Hopefully it’ll be back soon, otherwise I’ll have to invent a reason to give to my boss on why I can’t get back to the office!
So what is their stack, or where can I find more about it? A totally custom webserver? Someone commented to this effect the yesterday [1], but I couldn't find much in the way of a good writeup, except this answer from 2009 [2].
Scott Hanselman had an interview with the Stack Overflow Director of Engineering just a few weeks ago. They cover some high-level details there [0]. As I understand it's an .NET Core monolith with a very-large (~1.5 TB RAM) SQL Server backend.
I remember hearing that they are a .NET stack with C# and SQL Server.
The only reason I know that is because I was working at a company and discussing the issues the company was running into scaling SQL Server and Stack Overflow was used as a counter example of SQL Server scalability. It lead into a long discussion of caching on high read workloads.
I'll never touch SQL Server again if I can help it.
I know you're joking, but an SE employee (I believe it was Nick Craver, who is now a former SE SRE) mentioned on Twitter a while ago that employees use database backups and spin up local instances for exactly this reason...
[+] [-] ctvo|3 years ago|reply
- FREE
- Permissive content license
- Doesn't require me to log in to read an answer
- Few / limited ads
- Data available at archive.org
- Still independently owned. Imagine AWS or Microsoft buying it. Oof.
I think about LinkedIn, Github, ... the other large platforms we use for work, and SE is the only one that hasn't gone downhill.
No, I don't want them to open source the platform. No, I don't think you can do better. Yes, a few mirrors for redundancy would be excellent, but not urgent. Discoverability here would be the challenge for mirrors. They've been down less than a day total for me in 10+ years of using them.
[+] [-] jodrellblank|3 years ago|reply
Owned by a VC firm, isn't it? https://www.forbes.com/sites/vijaygurbaxani/2021/06/08/the-1...
after https://vcnewsdaily.com/stack-overflow/venture-capital-fundi...
[+] [-] donmcronald|3 years ago|reply
The cookie dialog being different on every site is infuriating if you’re not logged in.
[+] [-] motbus3|3 years ago|reply
it is only bad they are having some many outages these days. I am not complaining for me. but it means something is happening there
[+] [-] vdchuyen|3 years ago|reply
[deleted]
[+] [-] blacklight|3 years ago|reply
So bad for a website that is basically the go-to resource where IT professionals get their answers.
So bad that the whole platform is closed-source, so we can't even spin multiple instances.
The main resource used by developers and sysadmins around the world is locked and centralized, and when that central place goes down all the answers go down with it.
We need crawlers and scrapers to download EVERYTHING out of the SE platforms, and they need to do so on a daily basis. All content on SE must be mirrored across the world, and if they don't want to do it then we'll do the scraping for them.
And, most of all, we need alternatives that are open and decentralized, and we need them right now.
[+] [-] zufallsheld|3 years ago|reply
So nothing is stopping anyone to spin-up multiple instances.
[+] [-] someguy5344523|3 years ago|reply
I think that's already the case. Whenever I look up a technical issue, the first result is usually from SO; the next results are usually from websites that copied that first SO page
[+] [-] amanj41|3 years ago|reply
[+] [-] knowhy|3 years ago|reply
https://archive.org/download/stackexchange
[+] [-] hddherman|3 years ago|reply
Content packages: https://wiki.kiwix.org/wiki/Content_in_all_languages
Example of how a site looks like (in this case SuperUser), hosted on my server: https://kiwix.ounapuu.ee/superuser.com_en_all_2021-04/A/inde...
And hosting it really isn't all that difficult: https://ounapuu.ee/posts/2021/12/09/self-hosting-wikipedia/
[+] [-] Pengtuzi|3 years ago|reply
Awesome! Let us know when we can start using your new open source service, it must be mirrored and need it right now.
[+] [-] pugworthy|3 years ago|reply
We all joke about the dependency on SO. It seems to actually be more true than perhaps we’d like to admit.
[+] [-] NateEag|3 years ago|reply
https://www.codidact.org/
[+] [-] unknown|3 years ago|reply
[deleted]
[+] [-] ankaAr|3 years ago|reply
My first option was a full copy of stackoverflow. No joke.
Now, I'm reading this 5 hours letter and everything is ok, but what a wonderful site.
[+] [-] JLCarveth|3 years ago|reply
[+] [-] connordoner|3 years ago|reply
[+] [-] msoad|3 years ago|reply
[+] [-] ravenstine|3 years ago|reply
[+] [-] racl101|3 years ago|reply
Not sure that will work.
[+] [-] coffeeblack|3 years ago|reply
[+] [-] mproud|3 years ago|reply
[+] [-] nfhshy68|3 years ago|reply
[deleted]
[+] [-] jollyllama|3 years ago|reply
1 https://news.ycombinator.com/item?id=32321726 2 https://stackoverflow.com/questions/676326/how-does-stackove...
[+] [-] artimaeis|3 years ago|reply
[0] https://hanselminutes.com/847/engineering-stack-overflow-wit...
[+] [-] dixie_land|3 years ago|reply
[+] [-] bakje|3 years ago|reply
I'm assuming stackoverflow runs as a part of all this, and not separately.
1 https://meta.stackexchange.com/a/10370
[+] [-] brightball|3 years ago|reply
The only reason I know that is because I was working at a company and discussing the issues the company was running into scaling SQL Server and Stack Overflow was used as a counter example of SQL Server scalability. It lead into a long discussion of caching on high read workloads.
I'll never touch SQL Server again if I can help it.
[+] [-] kadonoishi|3 years ago|reply
[+] [-] pid_0|3 years ago|reply
[deleted]
[+] [-] hokkos|3 years ago|reply
[+] [-] mellosouls|3 years ago|reply
[+] [-] pkstn|3 years ago|reply
[+] [-] iostream25|3 years ago|reply
[+] [-] uhhhhuhyes|3 years ago|reply
[deleted]
[+] [-] Victerius|3 years ago|reply
[deleted]
[+] [-] ollien|3 years ago|reply
[+] [-] iasay|3 years ago|reply
[+] [-] Candas1|3 years ago|reply
[deleted]