top | item 46742293

(no title)

arcade79 | 1 month ago

While reading this kind of articles, I'm always surprised by how small the storage described is. Given that Microsoft released their paper on LRCs in 2012, Google patented a bunch in 2010, facebook talked about their stuff around the 2010-2014 era too. CEPH started getting good erasure codes around 2016-2020.

Has any of the big ones released articles on their storage systems in the last 5-10 years?

discuss

order

smueller1234|1 month ago

IIRC, the most recent and most technical public content we (Google) have published on Colossus are these:

https://cloud.google.com/blog/products/storage-data-transfer...

https://cloud.google.com/blog/products/storage-data-transfer...

Facebook's published content on Tectonic is quite good and I think it's well more recent than 2010-14.

(Current Google employee, just pointing to public content, hope that's helpful.)

arcade79|1 month ago

Nice, the L4 cache seem to be a newish addition. Love the detail about two filesystems with >10 exabytes of storage.

theMMaI|1 month ago

All the big ones have talked about their storage systems, but have been reluctant publishing papers like they used to do, so it appears to be more of a marketing focused effort than trying to share the technical details with the world.