How does IFPS index new content that's added to the stackexchange network daily? And/or how long does it take to add new data?
Ideally your approach to pulling the data from its source into IPFS is somewhat deterministic, so that you get de-duplication and generally more efficient updates.