done
180 karma · joined April 18, 2007
As for the tech, given the requests we need to handle from our distributed queue, we do clustered stream processing in near realtime. Our broadcast customers want a line on their screen within a second or two.
And for now we are bootstrapped.
My gut says that it will become commonplace to need to handle tera or petabyte-sized data. 640K turned out to be a wee bit shy of our memory needs. Traditional RDBMS's will turn out to be a wee bit shy of our analysis needs.
Dude, $50 the Smails kid picks his nose.