417 karma · joined June 18, 2011
I think the understand this already though. With the release of stuff like 3d diffs now it's the "GitHub of CAD", I could imagine a useful future for the "GitHub of legal documents", "GitHub of _____"....
As for where you hook into the stack, it's definitely a tradeoff. The lower level you go, the wider your coverage, but it also becomes more generic and potentially less actionable data.
I've worked on building a similar system at AppNeta (it's basically commercial Google Dapper). Here's some slides from a lightning talk I gave about distributed tracing at Surge last year: http://www.slideshare.net/dkuebrich/distributed-tracing-in-5...
For example, if you introduce a new ajax endpoint in the release, and a client hits a new worker generating a HTML page that calls it, but 90% of your gunicorn workers are still serving the old version of the app, 90% chance that you're going to 404 that request.
The guys I talked to cited both the future (now present) "dyno is not a unit" problem, as well as reporting user dissatisfaction with non-flat-rate billing.
Here's the writeup: https://www.appneta.com/2013/02/21/the-taming-of-the-queue-m...
(Spoilers: turns out it gets a lot better very quickly.)
But I do think it's a bit disingenuous to compare the "mistakes" of scientists to fabrication and deceit. Would Niels Bohr have been referring to the manufacture of evidence when he spoke of "all the mistakes that can be made in a very narrow field?"
Full-Stack Software Engineer, Front-End Engineer
We're working on an awesome product that helps devops run their web apps more efficiently. We do distributed tracing, ala Google Dapper / Twitter Zipkin, then turn it into actionable SAAS-delivered performance insights.
Our team is super-smart, very autonomous, and well-funded. We get to work with cool technology and solve high-data-volume problems in real time.
Technologies: Python, D3, backbone.js, C/C++, Cassandra, MySQL, EC2, git
More info: http://tracelytics.com/jobs
(we've also got hackers located in Providence, RI and Vancouver, BC -- inquire within for details!)