We just added Clickhouse sink support to SQLFlow:
- https://github.com/turbolytics/sql-flow/issues/100
- https://github.com/turbolytics/sql-flow/pull/116
The Clickhouse python API made this trivial thanks to supporting Arrow!
We have a tutorial explaining how to stream data from Kafka to Clickhouse using SQLFlow:
https://sql-flow.com/docs/tutorials/clickhouse-sink
Local benchmarks show 70,000 rows / second insert using a batch size of 50k!