Although there is a lot of data here, it seems all of it is roughly repetitive, relational data. Why not store it in a central database?
I have a (much smaller project) that stores all data in a postgres datastore.
I have a (much smaller project) that stores all data in a postgres datastore.
Doesn't mean you have to go and fully normalize everything and make a production-level database!