Have a look at Elasticsearch. https://www.elastic.co/products/elasticsearch
Disclaimer: I work for Elastic.
Disclaimer: I work for Elastic.
You guys should build in some better profiling tools for logstash. I'd love to be able to see how much time each filter rule took to know where to spend my time optimizing. Since its all in a java virtual machine its tough to see things like how many threads are working hard vs idle and how much memory each is using etc.
Feel free to drop me an email (in my bio) I’d love to help if I can!