Congratulations for the launch and thanks for making it open source!
Why using 6 databases? Kafka, redis, Postgres, ClickHouse, influxdb, opensearch
Why?
Why using 6 databases? Kafka, redis, Postgres, ClickHouse, influxdb, opensearch
Why?
Kafka - buffers data ingest so that we never lose recordings. Redis - acts as a cache, optimized for write-heavy processing in our app. Postgres - stores metadata for the data we record. ClickHouse - stores logs and other time-series data that need to be aggregated.
We're looking to simplify the system and replacing InfluxDB + OpenSearch in the near future with ClickHouse as a more performance and cost-effective solution that has proven simpler to maintain.