TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Processing 1M Updates per Second

1 pointsby maycotteover 2 years ago

1 comment

maycotteover 2 years ago
Tremor Video is processing data on 20B devices with greater than 30k attributes and is updating them at a rate of greater than 1 million records per second using FeatureBase. Not only is the ingest throughput amazing but reduced the hardware footprint of the main table to ~12TB from ~200TB in other, much slower and much more complex databases like Cloudera, Druid, Vertica, ArangoDB, Redis, and Aerospike.