Ask HN: Where to run a large data project
I've been asked to do a data processing job by a friend. As part of the job, I'm supposed to download and process roughly 1.5tb of data. That's a problem because my local ISP data cap is 300gb a month.
So I'd like to ask: what recommendations does hn have for me? I was thinking of getting a private server and trying to get some cheap storage, but I'm not sure where to go for that.
Side note: not only do I have to download a huge data set, but I have to make a bunch of whois calls based on some IPs in the data set.