Hacker News Reader

Possibly behavoiral logs - A clicks on B's profile, views C's photo P1 and P2, plays game G1, chats with D and E.

These are clickstream logs for sure. The guys at Facebook always talk about this Hadoop-based system in the context of analyzing users, rather than systems.

I have been tempted to use Hadoop/Hive myself, but what I'm REALLY interested in is Yahoo's column-store DB, Everest. Being able to use SQL with these monster-sized data sets would open up a lot of possibilities.

Everest was replaced by Hadoop + Pig, Yahoo's take on a Hive-like system. Both Hive and Pig allow you to use SQL.

Hive and Pig are not SQL though. Yes, they're SQL-like, and do go some way towards solving that problem, but you won't be using things like standard DB libraries with them anytime soon.

Hive has ODBC and JDBC drivers. What SQL functionality are you missing?

Reply on news.ycombinator.com