WingNews logo WingNews GitHub [2]
top | item 10423604

Jepsen: Distributed Systems Safety Analysis

285 points| luu | 10 years ago |jepsen.io

60 comments

order
[+] willchen|10 years ago|reply
I'd be very interested to see RethinkDB analyzed, particularly with the 2.1 release promising high availability through Raft. RethinkDB and Aphyr have talked about doing Jepsen tests for it, but I'm not sure where that's landed (https://github.com/rethinkdb/rethinkdb/issues/1493).
[+] coffeemug|10 years ago|reply
Slava @ Rethink here. Talked to Kyle yesterday, he's doing RethinkDB analysis next. You should see something in a month or two.

EDIT: don't mean to speak for him though; I hope this is ok.

[+] OMGWTF|10 years ago|reply
> Flash plugin missing

> Get the latest Flash player to view this content

No, I won't. This scares me too much: https://www.cvedetails.com/vulnerability-list/vendor_id-53/p...

[+] annnnd|10 years ago|reply
+1.

Not sure why anyone would want to play video (I guess it's a video? I don't do Flash either) through Flash nowadays... Isn't it easier and better to just use HTML video tag?

[+] fowlduck|10 years ago|reply
I'll transcode the vid and set up videojs properly, if it'll help
[+] mdaniel|10 years ago|reply
I especially enjoyed this comment from a user entitled OMGWTF :-)
[+] striking|10 years ago|reply
A lot of people are noting their interest in seeing a certain database tested. Sorry to say so, but:

>> Can you test X next?

> Tests take about a month. I do take suggestions into consideration, but I can't promise you anything. Backlog is a few years long at this point.

(from https://aphyr.com/about)

[+] willchen|10 years ago|reply
Fair point. For RethinkDB, I think there's a good business case for getting it tested sooner than later (on both sides). For aphyr who's leaving Stripe, I think it would be reasonable for RethinkDB to compensate him for an unbiased study, given that they have $12M+ in funding. A positive report could generate a lot of attention for RethinkDB and give confidence to larger enterprises who are very hesitant of trying anything remotely "new" or "experimental" in the DB space.
[+] headcanon|10 years ago|reply
I wonder if Carly Rae Jepsen is aware of the legacy of her song in the software world...
[+] annnnd|10 years ago|reply
Especially as the product is named after her... This for sure doesn't hurt her image, but some lawyers might have a problem with this.
[+] JoelJacobson|10 years ago|reply
Why isn't PostgreSQL in the list on the first page? It is in the [blog posts] page though.

I would love to see the multixact data corruption problems introduced in 9.3 analyzed, and see if he can verify them to be solved in the latest version.

[+] rdtsc|10 years ago|reply
(Not author) but from what I remember PostreSQL was a bit of a funny case. It was about partitions between clients and a single database server. In most other cases, it was analysis of distributed back-end server instances. Not that those failures are not important but it is just harder to compare it seems with the others.
[+] amitlan|10 years ago|reply
Not quite sure whether something like multixact data corruption is symptomatic of the kind of underlying issues in database system implementations that Jepsen is after. I may be wrong though.
[+] threeseed|10 years ago|reply
PostgreSQL was tested in single mode. All others distributed.

Apples and Oranges.

[+] eddd|10 years ago|reply
I really dig the Riak test. One of the best comparison of LWW and CRDT. Also very good conclusion, tl; dr: If you don't use idempotent writes, you are going to have bad time.
[+] rspeer|10 years ago|reply
Well, Last Write Wins is idempotent too. I would say the conclusion is that it's important that your writes are commutative and associative.

(The problem, then, is that data structures with all these properties are hard to find.)

[+] felixgallo|10 years ago|reply
On a human note: Kyle is brave as fuck for stepping out into the black unknown yawning abyss to try to do this under his own banner. Bravo, Kyle, and may you find incredible success.
[+] mdaniel|10 years ago|reply
The other side to that coin is that these reports are always in the top of the front page of HN, and likely on Reddit, also. They are popular because they are great, and I don't want to live in a world where people can't be paid fairly to do great things.
[+] doomrobo|10 years ago|reply
Was Jespen developed at Stripe? If so, how can aphyr get the rights to use Jespen for individual contracting work?