2022 Cloud Report

[lbhdc]

https://www.cockroachlabs.com/guides/thank-you/?pdf=/pdf/202...

Here is the direct link to the report

[fckgw]

Even more direct :)

https://www.cockroachlabs.com/pdf/2022-cloud-report-cockroac...

[Queue29]

This blog post is literally unreadable with animations flying around covering up content, is that by design?

[Thev00d00]

It also ignores the "prefers-reduced-motion" CSS Media feature flag :(

[soco]

This feels like back in the 90s with those GIF-laden scrolling text webpages. I can't fathom what goes into the mind of a designer creating all this nonsense for what basically is a table report. Does anyone in their right mind expect people would be more attracted by banners frolicking around?

[colinmhayes]

Probably, they want you to download their report which requires a work email nad personal details.

[estambar]

The website has been updated to resolve some of the animation issues - is it better now?

[nemothekid]

These blog posts used to be really good in comparing different clouds; I'm not sure why they decided that this was the optimal way to display this information.

[dsiegel2275]

The JavaScript console is your friend:

document.querySelectorAll('.aos-init').forEach(e => e.remove())

The above will remove all of those popups.

[alex3305]

I have Windows zoomed in at 125% and at my 1080p height screen some content boxes don't even fit my full view height. Thankfully the full report is direct linked here.

[namibj]

I had confirmed that the overlay is intended teasing to get you to download the PDF.

[mekster]

Can we just go back to good old days and stop with animations to bring the content from all directions which is even slow enough I get blank screen for a few seconds as I scroll down which really reduces the readability.

[Thev00d00]

It also ignores the "prefers-reduced-motion" CSS Media feature flag :(

[smarx007]

From p. 74:

> Overall, the gap for most AMD-based processors closed almost immediately when we controlled for NUMA nodes – in other words, when we only considered runs where each instance showed all vCPUs running across a single NUMA node. When we did this, the performance gap dropped from 22% to 1%, which is smaller than our margin of error.

How does one avoid machines with vCPUs across multiple NUMA nodes? Do you just spin the machine up, run `lscpu | grep 'NUMA node(s)'` and kill the machine if the value reported is anything but 1 and try to spin a VM again?

[estambar]

That's what we did, yes

[hesdeadjim]

As a AMD fanboy who loves seeing them back on top, I’m just happy we have a competitive CPU market now. I’ll include the M-series from Apple as well, despite being platform locked, because it also forces the other players to up their game.

I would love to see an AMD chip as fully integrated as an M1, moving the RAM fully on die and part of the Infinity fabric directly. The insane memory bandwidth of the M1 is what keeps it competitive.

[ericmay]

Yes! How awesome is it that we've got companies like AMD, Intel, Nvidia, ARM, Apple + TSMC for M series, and others who are cranking out awesome products?

Sometimes we get lost in the criticism of every little thing that these companies do and forget that honestly, they're all cranking out great products.

[matthewmacleod]

I would love to see an AMD chip as fully integrated as an M1, moving the RAM fully on die and part of the Infinity fabric directly. The insane memory bandwidth of the M1 is what keeps it competitive.

I know this has been said a million times, but it's worth repeating because somehow the idea is still floating around – the M series very much does not have the RAM on-die. It's not even in the same package – it's standard LPDDR4/5 sitting off to the side with a lot of channels.

[WithinReason]

> I would love to see an AMD chip as fully integrated as an M1, moving the RAM fully on die and part of the Infinity fabric directly.

Current rumours suggest that's where AMD is heading, Zen 5 having multiple accelerators integrated and Zen 6 having HBM part of the package (on the datacenter variants):

https://youtu.be/6yFn85I5PbY?t=1222

[how2cflags]

As someone who has recently bought into AMD from a long hiatus, I have to say they've come a long way since and I've been personally impressed with what I've experienced so far on the hardware side. That said, the reverse can be equally said on other matters pertaining to their business as well; more specifically their customer support pertaining to RMA's as of late. Mind you, this is all a personal anecdote so take with a grain of sand.

[DeathArrow]

>As a AMD fanboy who loves seeing them back on top

I am not a fanboy, but a realistic dude.

AMD ruled the last years but Alder Lake overtook Vermeer on both performance and price/performance.

And that is with a process node difference, Intel using 10nm vs AMD using 7nm.

And the future looks like Intel will enhance the distance between its performance and AMD's.

[vlovich123]

Am I misreading the report or is GCP faster for network/disk, have more consistent performance (at least for network), & offer cheaper pricing? Aside from vendor lock-in (or potentially negotiated rates for large ENT accounts altering the economics), is there any reason to choose AWS/Azure instead of GCP?

[sharms]

Each cloud comes with unique service / API complexity and despite being managed services that experience does not translate 1:1 across clouds. For example AWS IAM policies cannot be reused, and there may be differences in availability, durability, feature set et al. A good reason to choose AWS may be to minimize deltas between stacks, and often it is a fair assumption that their service offerings have been used by a significant amount of enterprises.

[EugeneOZ]

Dear webmasters, for “simple” cookies settings windows like this, you should be tortured equally. https://ibb.co/dp89vYQ

You are trying to “make” the users click “Allow all” just to hide this trash as quickly as possible. It is low.

[capableweb]

It's not even low, but straight up breaking the regulations which made them put up that banner in the first place. But seems companies haven't yet understood that, nor have governments actually enforced anything so, here we are.

[Narishma]

The whole website seems ill-conceived, with popups appearing above the graphs they're supposed to explain and obscuring them.

[nix23]

cockroachlabs..... ;)

[jeffbee]

I wonder why they did not test the Amazon 6a class. The report gives the impression that Amazon lacks an implementation of the 3rd-gen EPYC.

[shaicoleman]

"Note: Because of our machine selection and testing cutoff times, we were unable to test AWS’s m6a instances, which also run AMD’s Milan processors. Based on the rest of our testing, we expect that the m6a instances could have outperformed m6i."

[yekurtal]

Direct download link: https://www.cockroachlabs.com/pdf/2022-cloud-report-cockroac...

[ghishadow]

thanks

[bjornsing]

How about ARM? Included in the report?

[lbhdc]

From the pdf of the report

>We chose not to test ARM instance types this year as CockroachDB still does not provide official binaries for that processor platform. Official support for ARM binaries is slated for our Fall release (22.2), so we expect to return to testing this processor platform next year.

[guepe]

There is very little offering and honestly afaik they are not competing on performance except niche applications.

It's not that easy to displace x86...

[matdehaast]

Last I checked cockroach don’t support ARM binaries. Probably means they thought not worth the effort to do the analysis on those instances as it doesn’t help for their offering

[suggala]

Benchmark was executed only for CPU intensive node configurations. For highmem node configurations, AMD is not performing well. Probably need to title the report as Cloud Report for CPU intensive workloads. For memory intensive workloads, this report is not doing enough justice.

[Rafuino]

Can you elaborate on what you'd expect to see if they tested the highmem node configs?

[estambar]

We are addressing some of the page rendering issues discussed in the comments below and hope to have them resolved soon. Sorry about that!

[tofuahdude]

These animations are painful!

[candiddevmike]

Wonder how cockroach is doing these days with all the competition in the space.

[echelon]

I don't follow their product closely. Who are their competitors?

(If I were in the market for their database and the alternatives were close in parity and price, I'd be likely to choose a competitor for the name not being "cockroach" alone.)

[digb]

was discussing this the other day with colleagues. you google CockroachDB and are immediately served Yugabyte and PlanetScale, which are imo much "hotter" right now