Ask HN: Fast Read-Only Relational Data Store

3 pointselsherbini2 comments

I don't mind if building the database takes on the order of days, but I'd like queries to be as quick as possible. If I get new data, I am fine rebuilding the database from scratch rather than inserting. (New data comes in on the order of months to years).

I have several related datasets that I'd like to query. The datasets are currently stored in flat files. The largest data set is 4 million rows x 20 columns, the next largest is 50000x1300 (or 650 million x 3 if "melted"). There are 5 bigger data tables, and several small metadata tables.

What sort of database would be best for this size and these goals? What additional information would you need before recommending a solution?

View on HN