Hacker News Reader

> if your data can fit into RAM, what exactly are we talking about Big Data for?

That's a fantastic point, and I keep mentioning the COST paper to anyone who cares:

https://www.usenix.org/system/files/conference/hotos15/hotos...

COVID was proof The Right Data is better than Big Data. All those data sources to measure how many sick people we have and it turns out we just need one: Wastewater.

Or another way to look at it - if we make a data lake that collects everyone’s shit we might find something useful in it!

Reply on news.ycombinator.com