Hacker News Reader

Comment by dkhenry | Hacker News Reader

I always knew the company I work for does cool things with MySQL, but I never knew how far we really have pushed the envelope until I see how much more we push MySQL then the twitters and facebooks of the world. Doing some napkin math I would say our largest cluster of MySQL does about 320 Billion inserts a Day across 80 nodes and some of our nodes can peak at about 200K queries per second ( that would be 16 Million QPS if all the nodes were fully loaded ). Meaning at one of our installs we do the same volume as two facebooks !

View on HN

Curious what type of servers, what type of writes, do you use compression, how you shard, what type of indexes? Write an article for highscalability and get exposure?

Out of curiosity, what industry do you work in?

Performance Monitoring.

Ah, that'll do it.

Coincidently I work on performance monitoring at Facebook. We gave up logging perf data to MySQL because it was a management headache at scale. So instead my colleagues built Scuba, which is essentially a search engine they taught to perform aggregate functions.

http://gigaom.com/cloud/exclusive-facebooks-scuba-project-di...

Lots of people gave up trying to do their own performance logging, it turns out its a non trivial problem when you get to large scale systems. Which is why the company I work for exists.

Does the name start with New and end with Relic, by chance? :) I'd love to compare notes sometime. My email's in my profile.

No, but I understand why you might think that. I sent you an E-mail.

Your company is easy to find on Google. It's not stealth, and it's venture-funded. Curious why you can't or won't mention the name here.

I am in no way an official spokesperson for them, just a developer, I don't know how much publicity I am allowed to draw to our back end architecture without getting into trouble. It is after all the thing that separates us from everyone else out there. (BTW I have posted the Who's Hiring post a couple times so my Username is pretty easy to track to whom I work for)

Reply on news.ycombinator.com