Previously on HN, a similar approach demonstrating that command-line tools can be hundreds of times faster than the fancy distributed approach (for certain classes of problems):
"Command-line tools can be faster than your Hadoop cluster"
"Command-line tools can be faster than your Hadoop cluster"
since we're throwing links around, the (tangentially related) Knuth vs. McIlroy saga comes to mind: https://news.ycombinator.com/item?id=15264997
Interestingly, the dumps come with a brief README file telling you... to use the zgrep and example arguments :)
Let me know when you have a solution for using command line tools for sorting through our 4PB of data in our Hadoop cluster!
Use the right tools for the right jobs :)