TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: What is your Big Data Stack

8 pointsby Rain_makerover 12 years ago
If You/Your company are involved in big data , please elaborate on the Stack you are using, your workload, how well does the stack hold against worload.

1 comment

traxtechover 12 years ago
I don't know if it qualify as "big data", but to fetch, index, classify (meta-data analysis) and rerank daily (6 hours) a set of more than 5 millions medical publications, the stack is simple :<p>- Glassfish 3 (EJB, JPA, JSF)<p>- PostgreSQL 9<p>- Lucene (used as an index and as a NoSQL store)<p>- hardware: blazing fast SSD and 8GB+ RAM for PostgreSQL<p>I'm impressed by PostgreSQL, handling without a fuss tables containing more than 60 millions entries (well, I like tuning the DB conf and the ORM, it's usually the best effort/result ratio in devs :)