I just came here to thank Jepsen for these amazing reports. What a wonderful way to use your intellect to contribute to the wellbeing of the entire community.<p>Also I wanted to say to redpanda: I was on the fence but now I’m convinced. Will definitely be deploying on my next project, which has already kicked off. I only wish I could run it natively on MacOS instead of requiring docker.
The level of intellectual discipline and competence on display here is inspiring.<p>I'd love to take one of the Jepsen courses, but it seems they're offered only as corporate training. Maybe my employeer will agree to bring them in.<p>For now I'll have to satisfy myself with the YouTube videos.
This isn't anything against Redpanda, but I'm always amazed how badly all these distributed databases do in Jepsen.<p>What would one use them for in practice, which wouldn't be better suitable by a (the thing I've used), say postgresql and streaming replication in case the server goes down? (I'm not suggesting there isn't a good application, just I'm not knowledgeable enough to know of one).
This report seems to have some wrong insights. Auto-commit offsets doesn't imply dataloss if records are processed synchronously. This is the safest way to test Kafka instead of commit offsets manually
The blog for a deeper dive into results, fixes, and discussion on the write behavior in the kafka protocol. <a href="https://redpanda.com/blog/redpanda-official-jepsen-report-and-analysis/" rel="nofollow">https://redpanda.com/blog/redpanda-official-jepsen-report-an...</a>
Always great to read this. I preformed a jenkins test on Microsoft internal infra and it's a huge insight. From an academic side it's just as interesting looking into the lack of standards within consistently and the definitions of them.
> A KafkaConsumer, by contrast, will happily connect to a jar of applesauce14 and return successful, empty result sets for every call to consumer.poll. This makes it surprisingly difficult to tell the difference between “everything is fine and I’m up to date” versus “the cluster is on fire”, and led to significant confusion in our tests.<p>This tickled my funny bone. Never expected humor in a Jepsen writeup. Kudos!
Redpanda (back when they were VectorizedIO) spammed my work email after I starred one of their repos, denied it after I called them out on it and I just noticed that they had deleted their response to me.<p>Pretty sneaky to go back and delete the tweets first denying and then apologizing.<p>Receipts: <a href="https://twitter.com/d11cc3s/status/1447573471152656389" rel="nofollow">https://twitter.com/d11cc3s/status/1447573471152656389</a> <a href="https://twitter.com/d11cc3s/status/1450906855115354116" rel="nofollow">https://twitter.com/d11cc3s/status/1450906855115354116</a>