Show HN: Columnar store for fast, lightweight logging
github.com
Parseable is a lightweight log ingestion and query engine written in Rust. Parseable can ingest data from existing logging agents (FluentBit, LogStash, Vector, syslog-ng and more) using HTTP + JSON output. Ingested logs are stored as semi-indexed Parquet files (on disk or S3).
You can query the data with builtin query engine using SQL or use a query engines of choice like Spark, Presto, Trino and so on.
We also developed a Grafana data source plugin that lets you visualise log data via Grafana. Sample dashboard link in readme.
As log data grew, our industry has responded with SaaS and fully managed offerings, but if you're looking for freedom, interoperability and full control over your data - there are no great options. With Parseable, we are looking to provide an strong, viable and FOSS alternative.