3,082 karma · joined April 14, 2008
I used to have this same problem. My solution is to push items into the future if it's clear I'm not going to be able to get to them the next day. Sort of like GTD's tickler file. As long as your todo list tool allows you to add dates, you can view only items due today. That's made having a large list of tasks much easier to manage, because I only see what I have to work on today.
cat myfile.txt | awk '{do_stuff()}' | sort -u | column --table > new-myfile.txt> Update 12-04-2017: This feature was removed in PHP 5.5.
However, I've been looking at pCloud and it checks most of the boxes, though I haven't tested with a million files. 2 TB is $10/month and they have lifetime deals. For an additional fee you can get client-side encryption.
The reason for asking is I'd like to find a self-hosted ngrok solution for development.
But for a self-hosted markdown wiki, this looks great. A local authentication option would make it even better (currently uses Slack or Google OAuth).