TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: Distributed, Persistent Hash Set?

2 pointsby paladin314159over 5 years ago
Hey all, I have a use case that sounds relatively simple, and it&#x27;s scoped very specifically. I need add&#x2F;exists functionality on a large, distributed dataset (1 trillion entries at 20B&#x2F;entry) at high throughput (1MM ops&#x2F;sec) and low latency (single digit ms). Operational simplicity is important, so HA and easily scaling up&#x2F;down should be built-in. Ideally it isn&#x27;t too expensive either (100k&#x2F;year ballpark would be great).<p>Does such a technology exist? Stuff like Cassandra or DynamoDB are heavily used, but I&#x27;ve had trouble operating Cassandra in the past and DynamoDB is too expensive for this use case. There are dozens of other distributed databases that have way less adoption that I&#x27;d be worried about from an operational complexity perspective. Anyone have a good experience worth sharing?<p>Thanks!

no comments

no comments