TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Fluentd: the missing log collector

50 pointsby kzk_moverover 13 years ago

4 comments

doryokujinover 13 years ago
Cool! Handling each event record as a structured data (JSON) is very interesting, because it can connect with MongoDB(DocumentDB) seamlessly for stream output or aggregation. This slide is written about a collaboration with Fluentd and MongoDB. <a href="http://www.slideshare.net/doryokujin/an-introduction-to-fluent-mongodb-plugins" rel="nofollow">http://www.slideshare.net/doryokujin/an-introduction-to-flue...</a>
评论 #3258569 未加载
abhishektwrover 13 years ago
Excellent, and I am going to try it. But I still think using something like Flume has some advantages mainly because of Hadoop eco-system. For instance you can plug-in the log data to HBase and use Hive to write to high level abstracted queries and run on Hadoop. I am guessing but seems like there are plugins on the way for various systems but not Hadoop. Update: Also Flume can use any data stream, for instance Twitter stream so not limited to log Analysis only.
评论 #3257844 未加载
maratdover 13 years ago
Err... what? Am I missing something? Just use rsyslog and transfer the logs over TCP/IP to a central server. No need to re-invent the wheel.
评论 #3259338 未加载
moaikidsover 13 years ago
coooool!!