Hacker News Reader

Have you had a chance to look at Fluentd? (Disclaimer: I'm a maintainer) Elasticsearch is far the most popular use case for Fluentd (much kudos to both the community and Elastic), and it's been pretty stable for awhile now.

View on HN

I gave it a try today. Wanted to send process stats to graphite. Installed it on Ubuntu Trusty, installed the graphite plugin and the process watch plugin and... The td-agent couldn't start watch metrics plugin was incompatible with the 0.12 version of fluentd. So I resorted to collectl.

Sorry to hear this. Can you give me the exact name of the plugin? I'd make sure to look at it.

No, I haven't yet, though I have heard the name here and there. I'm not going to be looking at logs again for a few months, but thanks for the pointer.

Then remember about Fluentd. I was using it for filling ElasticSearch with logs when Kibana was still written in PHP by a separate developer and was meant as a somewhat specialized frontend for logstash, not a generic one for ElasticSearch. I'm using it still for shipping logs (again to ElasticSearch) and metrics collected by monitoring, and I have even built a proof-of-concept of a stream processing engine for monitoring out of it.

You could go really far with Fluentd using or writing only few plugins.

Reply on news.ycombinator.com