TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Serial, Parallel, and Quorum Latencies

33 pointsby timfover 3 years ago

1 comment

jorangreefover 3 years ago
Thanks for making this. This is such a cool tool.<p>Would be awesome to see the tradeoff between network latency and network throughput, assuming that network throughput is not unlimited.<p>For example, a primary with a 1Gbps NIC may see less favorable latency profiles due to queueing theory if it&#x27;s replicating to backups in parallel but also ingesting data at a high rate.<p>This is where matching outgoing bandwidth 1-to-1 with incoming bandwidth, and spreading the primary&#x27;s load more evenly across all replicas for better stability, but still with 3&#x2F;5 quorum acks for grey failure tail-tolerance, might show slightly higher latencies, but with less of a latency cliff and significantly higher throughput, saturating the line rate.<p>We devised this technique for TigerBeetle, and it works extremely well together with Flexible Paxos, since you only pay the serial latency cost for the first synchronous replication hop from primary to next backup (subsequent serial hops between backups can then be async in terms of Flexible Paxos), and this is also ideal in terms of Viewstamped Replication since the next backup will also be the next primary and already have the latest log:<p><a href="https:&#x2F;&#x2F;github.com&#x2F;coilhq&#x2F;tigerbeetle&#x2F;blob&#x2F;main&#x2F;src&#x2F;vsr&#x2F;replica.zig#L630-L653" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;coilhq&#x2F;tigerbeetle&#x2F;blob&#x2F;main&#x2F;src&#x2F;vsr&#x2F;repl...</a>