TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Exactly-Once Messaging in Kafka

37 点作者 bkirwi超过 10 年前

3 条评论

mjb超过 10 年前
I&#x27;m the same &#x27;mjb&#x27; from the linked lobste.rs thread. If anybody is interested I expanded that comment into a blog post here: <a href="http://brooker.co.za/blog/2014/11/15/exactly-once.html" rel="nofollow">http:&#x2F;&#x2F;brooker.co.za&#x2F;blog&#x2F;2014&#x2F;11&#x2F;15&#x2F;exactly-once.html</a><p>The core problem here is making the act of writing down that you&#x27;ve done something atomic with doing the actual thing. If you can solve that problem, exactly-once processing is easy. If you can ignore that problem, for example because doing the thing is idempotent, exactly-once processing is easy. In the real world, however, it can be really difficult to solve these problems in general and very specific (and often &#x27;incorrect&#x27;) solutions are used. OP&#x27;s post talks about a bunch of those, which is very useful.<p>Very often, though, real-world systems settle for &#x27;at least once&#x27; or &#x27;at most once&#x27; and find out-of-band ways to handle the missing or duplicate messages. Whether this is practical or not depends on the message rate, and the cost of getting it wrong.
评论 #8883043 未加载
评论 #8883748 未加载
fintler超过 10 年前
Although indirectly related, the comments in <a href="https://issues.apache.org/jira/browse/SAMZA-390" rel="nofollow">https:&#x2F;&#x2F;issues.apache.org&#x2F;jira&#x2F;browse&#x2F;SAMZA-390</a> are also interesting reading (hi Ben!).<p>The Kafka&#x2F;Samza ecosystem is coming alive with tons of neat ways to interacting with streaming data. For example, take a look at <a href="https://github.com/milinda/Freshet" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;milinda&#x2F;Freshet</a>
评论 #8882703 未加载
brandtg超过 10 年前
Some caveats about Kafka replication are discussed here: <a href="https://aphyr.com/posts/293-call-me-maybe-kafka" rel="nofollow">https:&#x2F;&#x2F;aphyr.com&#x2F;posts&#x2F;293-call-me-maybe-kafka</a>.<p>It is important to include these in the &quot;exactly-once&quot; discussion... (hard to be exactly-once if messages are lost broker-side).<p>Also, great discussion from Coda Hale about &quot;CA&quot; systems here: <a href="http://codahale.com/you-cant-sacrifice-partition-tolerance/" rel="nofollow">http:&#x2F;&#x2F;codahale.com&#x2F;you-cant-sacrifice-partition-tolerance&#x2F;</a>