43 karma · joined May 30, 2011
PS: About time with dropping xvid for h264.
EDIT: I guess i forgot to mention the most obvious reason of all to go with memcached - what they have rolled out is by far the easiest caching system to implement. Not trolling, just stating the facts..
Yea it may be a lot of work to create a new GC implementation and change the threading model, but if you want the language to progress that's the way forward.
On a mostly unrelated note, the title of this post used to have the phrase "leading nosql database" in it, which is definitely marketing hyperbole :).
There are a number of jobs at google that although do not involve writing code, are closely coupled with the technology google is working on - developer relations actually being a very good example. I think they are keeping the bar high in these instances for valid reasons. I'm sure there are positions where technical background is less crucial, graphic design comes to mind, but that's to be judged on a case by case basis. Everybody wants to work there, so they can demand very high standards, but in most instances i've heard about the standards are not incorrect, just high.
EDIT: And probably another reason is they simply want to keep the particular technical culture throughout the company.
"However, no attempts have been made to optimize the Java VM, the SQL queries, etc"
Emphasis being on optimizing the sql. We have run tests comparing neo4j and postgres, and postgres comes out with greater throughput for our data set, where our database implementation was done people who know postgres extremely well. Where you will see especially great differences is aggregate queries, such as if you want to count the number of a certain type of connections coming into a set of nodes, and then sort these nodes by that number. A sql database is much better at stuff like that.
"I did an informal survey of different Los Angeles based Information technology companies. One common theme: although espousing a culture of innovation, and although some are very profitable, most are simply not cutting edge, and some are very behind the times."
An informal survey of LA start ups.. awesome. Any word on how exactly you went about conducting said survey? My guess is it was based on recalling random techcrunch articles read over the past couple years, but please correct if I'm wrong. LA has a ton of start ups that have all kinds of products, working environments and compensation levels, most of which I would guess the author never heard of.
"In most Silicon Valley Startups, coders know SQL, a major scripting language as well as HTML and CSS. However MySpace had positions solely for just HTML/CSS, a trend that harkened back to the 90s when web pages were manually created."
So basically, no one needs to know js and css/html anymore because they are all magically generated by some server side fairies. So facebook, twitter and google do not have people who specialize in js or css/html because that's just way too simple. Totally. For a product the size of what MySpace had, I think it would be shockingly incompetent to not have people who would specialize in that tech.
"Another Los Angeles great, eHarmony.com, uses 40 to 50 engineers for its matchmaking algorithm and servers, whereas OKCupid.com uses only 10."
In your survey, did you happen to ask them why they had such a discrepancy? Because i'm pretty sure it's not because eHarmony's employees are 5 times dumber than okCupid's. There could be a ton of reasons why these numbers are what they are besides lack of skill.
Anyway, I think this is an attempt to rationalize some failure the author has experienced at his previous job. But frankly I think this was a pretty bad attempt at generalizing something as big as the LA and SF job markets. Start ups exist everywhere and come in all shapes forms and sizes, LA has lots of them. To say that an entire city's worth of start ups is one way or another because of myspace, eharmony and your last work place is just way too simple. Anecdotally, I have friends in several LA start ups that are doing just fine, have working environments as good as their peers in SF, if not better, and are using the same range of technology people in SF use.
>we pair program to write all of our software. We work on Mac Pros with two keyboards and two monitors. We work in an open team room; no cubicles or private offices.
No thanks, if I'm the developer. And if i wouldn't do it, why would i make my employees.
Is there more info on the double update issue anywhere? It sounds like a really bad race condition.
a) Lack of online compaction (causing data set to be much bigger than necessary)
b) Broken auto sharding (complicating horizontal scaling)
c) "Scary" durability and scaling stories with auto sharding
Looks like auto-sharding has had a lot of work done, while online compaction still isn't there.
But in particular I'm curious about (c). What exactly is so scary durability wise with auto-sharding? Is it just the fact that it didn't work in 1.5/1.6?
2. Akamai might have played a part, but wasn't the main target of the load test.
3. See 1.. the MySpace data center is in the states.