TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Why we're building Scanner: data lake search must be fast

6 pointsby cliffcroslandover 1 year ago

1 comment

cliffcroslandover 1 year ago
We're really liking the combination of using Rust, AWS Lambda functions, and ECS Fargate. Everything runs well in ARM, but make sure to use `musl` instead of `glibc` - we've found memory usage to be almost 10x lower with `musl` than `glibc` for our use case (indexing and searching logs). If anyone wants to talk about the tech, happy to answer questions!