schleyfox

Hi, one of the Airbnb engineers involved in this op here. Yeah... that does sound a lot like 3 years ago. The situation has gotten a lot better, especially with 5.6 and PIOPS. These days, things work pretty smoothly (even as the volume of traffic and data has scaled massively).

From my understanding, Aurora is a modified MySQL with a few components substantially rewritten and a new, log-structured storage engine added that is well integrated with Amazon's storage infrastructure (volumes auto-grow, quorum is handled at the storage layer, replicas are just caching views on top of shared, replicated storage). MySQL has support for multiple storage engines over a relatively simple API, while Postgres is tightly integrated with its storage engine.

In addition, MySQL just has a lot fewer features and points of extensibility, so it would likely be easier to support.

We used sparkey for hammerspace, which is very similar to cdb. cdb was actually the first thing we evaluated, and it validated parts of our approach.

This is what we did, except leaning on file system cache instead of explicit mmapping.

Reading code is the best way to get better at programming. It's good to start with really smart, really good code, but you should also read bad and mediocre code (and more importantly, be able to figure out from reading why it is bad or whether it only seems bad at first glance.)

Reading code starts out being really hard, but with practice it can become almost as easy as reading prose. It's a winning proposition on all levels as you can pick up new techniques, understand how things are done (rather than just what they do), and see the trade offs and decisions that are actually made. Practicing code reading also improves debugging skills as you have to use the same skills to understand the what and the why of perfectly working but unfamiliar code.

Whenever anyone asks me what they should do to improve their programming, I usually suggest reading more source code. Another benefit is that code can't lie as easily or as convincingly as the documentation can.

One of the neat tricks with using the localhost HAProxy is that developer mode can just be a single Vagrant VM with all services configured to run on the port that they would have in Synapse. With HAProxy all the production servers think they are talking to localhost, and in development they actually are. The Vagrant VM can then be configured/reconfigured using Chef and the production cookbooks (with some overrides in the roles or environments). It should also be possible (though not entirely trivial) to run some of the services in the cloud for development, allowing developers to switch in and out the components that they need to actively develop.

South Africa was hard, but the hole for Lesotho was the big tip off for me.

The #10 state is Virginia, which is 20% African American (compared to California's 6.2%). I'd say that poverty is the more probable root cause.

Sadly, I think this is an increasingly recent phenomenon (get off my lawn). It's kind of funny given the style and length of HN favorites like pg and Steve Yegge.

I think in this case it is more accurate to label it as a parody. It sets up an exaggerated scenario that is clearly ridiculous, but it is only far enough from the current tulip mania to strip away some of the artifice. It's more akin to the I.T. Crowd (but with more verisimilitude), in which case we are exactly the right audience for it.

Is it really so hard to take existing talent and train them to use other languages? Especially in cases where the existing library and tooling ecosystems exist (e.g. anything based on the JVM) the actual language probably won't be a show stopper for the level of talent you need. If a new language takes a couple weeks to get up to speed in, so what? The bigger problem, IMO, is the existence of libraries and basic development tools like build systems and dependency management. I'm fairly pleased with how many of the newer languages that build on the JVM allow easy interop so that you can use the existing ecosystem when it makes sense.

You get that message fairly often because the implementation uses continuations (http://en.wikipedia.org/wiki/Continuation). This is one functional style for making a stateless protocol (HTTP) into a stateful one. HN could use a different design (one with less state) and avoid these issues with a few different trade-offs. This is an implementation detail rather than something specific to FP vs. non-FP. Also, best I can tell, HN still stores all of its data in flat files rather than a traditional datastore.

And you are falling into the "if I build it they will come" trap.

He definitely has a niche business. Many of us do. For most of us, our niche is tech. Patrick's niche is education.

In the tech/startup niche, often the extent of marketing that is required is posting to HN and getting featured by TechCrunch. Trying to expand our niche outside of this is probably a bad sign, and most likely ineffective. I hold this thread as a prime example of how much we hate advertising.

The education niche is quite different. You don't reach them by getting coverage for raising a round of financing or writing a blog post on SEO that casually mentions your cloud based retro encabulator. This "deceptive" marketing may be an effective way to raise interest in different segments of his target market.

Traditional online advertising is increasingly ineffective because of all the bad ads in that form. Would we be so quick to ignore all ad-like content if we hadn't been tempered with the aversion therapy of flash horrors, scams, and weightloss/white teeth/work at home? The end result is even advertising that might serve a useful purpose can't exist in that environment, so, like bacteria after the invention of penicillin, it has to adapt and change and find a new way to continue. If only "good" ads make the jump, then I think we're better off as a whole. If bad ads make the jump, we'll soon get pretty good at filtering them out as well. Honestly, if scam ads can blend seamlessly into a page, what does that say about the actual content?

Someone should tell the Nginx guys that blocking IO is not a problem that web servers actually have. I'm sure they will be thrilled to not have to do complicated event programming anymore.

I psuedo-dropped out* a week ago. I think the thing that really stuck out in my case was that all of my family and friends responded with a sincere "congratulations!" when I told them about it.

* I've scraped enough credits together to collect my CS degree in May with my peers, though I do miss the english lit classes I was taking.

There are deploys and then there are deploys. 99% of your deploys should be fine to go live whenever the code hits the repo. I definitely still prefer scheduled overnight deploys whenever significant infrastructure changes need to go live. Downtime should still be minimized, but sometimes a maintenance window is necessary.

Agreed. Can't we just say this has been a hard month for the tech community?

Amazon Prime isn't free shipping (as far as I know >$25 standard shipping is still a thing). It's a flat rate for unlimited 2 day shipping. Two day shipping is expensive, but the combination of an annual fee and the increased likelihood of purchases for subscribers is good for Amazon's bottom line. Subscribers get faster shipping and pay less as long as they order more than four or five things a year. It seems like a pretty decent win for both consumers and Amazon. I imagine Amazon's brick and mortar competitors are somewhat less amused.

MySQL and Postgres are awesome for a lot of what websites do. They have advantages and disadvantages. Things like sharding tend to be premature optimizations except for write-heavy sites running at high scale. I prefer a mixture of SQL and NoSQL for the projects I work on. Redis, especially, is great at things like atomic updates and counters that become cumbersome in sql. With a well architected model-layer the complexity of multiple datastores can be minimized significantly. By using the right tools for the job, we are often able to simplify even versus using one database and a hacky solution.

The one major advantage of the keyboard on the old models (and why I'm glad they are still being sold) is for students using ebooks in class. For my literature discussions we often have to reference specific sections so the keyboard, while crap, allows you to quickly search out a key phrase in the section under discussion. Page number mappings are still not all that available and often time off of weird editions that aren't even close to standard real paperback editions.

Seriously. Good pairs of slacks are about as comfortable as you can get in any situation. Part of the genius is the variety in materials that go in. You have everything from lightweight, super breathable pants perfect for the summer (when jeans and even khakis become miserable in any humidity) to thicker wool trousers that will feel comfortable even in the middle of a blizzard.

That said, the peak of summer comfort is seersucker, but I won't even don that often because it does make you look like an anachronistic dandy.

I like boat shoes and desert boots personally. Both are extremely versatile and go as well with jeans as they go with khakis or slacks. As an added bonus, they mostly come in browns, which provides additional discouragement to wear the developer black t-shirt.

I found git to make a lot more sense personally after reading http://eagain.net/articles/git-for-computer-scientists/ . The git parable is also very good.

"The old way, the Snow Leopard way, was that advanced features were purely optional. If you wanted multiple desktops, you activated Spaces. If you wanted to put the UI to work for multi-tasking, you used Expose. It was great for people who wanted more from their Macs, and it worked out perfectly for newer users who needed to ease into it all"

I think this was the point. Much of the effort in Lion seems to be around exposing useful, but esoteric features, that were present in previous versions. My perspective is that Apple wants everyone to be able to get more from their Macs, not just the elite power user set. Mission Control and full screen apps really make the case for virtual desktops. Spaces were basically lifted whole from Linux desktops, but they now actually feel well integrated into the Mac experience.

Just because someone is not an advanced user, it doesn't mean that they should not get advanced features.

"You can lead a horticulture, but you can't make her think." -- Dorothy Parker

37,700 http://testyourvocab.com/?r=36826 without cheating and not counting ones that I only thought I could puzzle out.

Maybe working on that English Minor is panning out...

Plenty of financial institutions have also made the studied choice to limit the length and types of characters I can use in my password.

I've spent a bit of time on the inside at NASA, specifically working on earth observing systems. There is a huge difference between the code quality of things that go into control systems for spacecraft (even then, meters vs. feet, really?) and the sort of analysis/theoretical code the article talks about. Spacecraft code gets real programmers and disciplined practices, while scientific code is generally spaghetti IDL/Matlab/Fortran.

There is a huge problem with even getting existing code to run on different machines. My team's work was primarily dealing with taking lots of project code (always emailed around, with versions in the file name) and rewriting it to produce data products that other people could even just view. Generally we'd just pull things like color coding out of the existing code and then write our processors from some combination of specifications and experimentation.

I'd agree that "unit tests" and trendy best practices are probably not the full answer, but the article is correct in emphasizing documentation, modularity, and source control. Source control alone would protect against bugs produced by simply running the wrong version of code.

Is this not an obvious effect of first class functions? Was it necessary to rename "functions" to "named callbacks"? Can't you do basically exactly this with function pointers in C?

Hopefully v8 will implement some of the things from Mozilla's Javascript 1.8 like generators, which will make evented programming more interesting.

We're working on it! Our current plan is to get new cities up every week or two. We perform a lot of curation and research on top of raw data sources to get the cities in. Any places you'd like to see in particular?