TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Quantcast File System on S3

20 pointsby lumensover 8 years ago

2 comments

lumensover 8 years ago
For some context:<p>Quantcast moved off Hadoop in favor of a home-rolled solution (QFS) because of Hadoop wasn&#x27;t scaling well to our needs (40PB+ data processed&#x2F;day).<p>This release of QFS (<a href="https:&#x2F;&#x2F;github.com&#x2F;quantcast&#x2F;qfs" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;quantcast&#x2F;qfs</a>) includes support for S3, among other improvements.
评论 #13065768 未加载
mck35over 8 years ago
Hi, we recently announced Quantcast File System version 1.2. Besides many bug fixes and improvements, it comes with the ability to use Amazon S3 as a backend store. You can check it out on QFS Github. I personally contributed to this release, and I&#x27;d be happy to answer any questions. Thanks.