If we're having milions of line of anything, just go with an actual db, no?
https://cloud.google.com/bigquery/docs/loading-data-cloud-st...
So instead of INSERT ... VALUES, you write INSERT ... FORMAT JSONEachRow and stream your data.
https://clickhouse.com/docs/en/sql-reference/statements/inse...