HNHacker News
TopNewBestAskShowJobs

shuzchen

1,391 karma · joined October 24, 2009

Entreprenurial minded developer, heavily invested in social good projects and current working in open source.
submissionscomments
shuzchen··on Some Interesting Facts About Hadoop MapReduce [pdf]
I'm not a "power-user", but I'm in the process of building a pretty big product powered by hadoop (more specifically, mrjob and amazon's EMR).

I have a hard time reading this as anything but satire. The author definitely knows a lot about hadoop, yet displays a misunderstanding of such a basic piece of it (conflating hadoop with map-reduce).

Just a few key things I can refute:

Hadoop as wasteful: production systems are built to withstand the expected peaks of traffic (i.e., some website that sees a huge influx when the east coast wakes up on monday morning will design with that load+buffer in mind), which means that ~90% (probably even higher!) of the time resources are underutilized. even personally my own laptop isn't chugging at 100% on all cores all day every day, I don't see how anybody expects any collection of computers to do so. On the flip side, this is being offset by platforms like AWS. When I run map-reduce jobs on hadoop, I spin up an EMR jobflow, run a few tasks and then shut it down. Presumably, somebody else gets to use those machines after I'm done.

Lack of third party support: Honestly, with mrjob and EMR, I've never needed to deal with any hadoop management, setup, maintenance or scaling. Also, all my code is python, I've not had to write a line of Java. And these aren't the only tools built on top of hadoop.

Hadoop as deprecated: there are certainly more big-data crunching platforms coming out nowadays, but hadoop is mature, stable, and still going strong. Also, the basic map-reduce framework it's based on is not going anywhere soon. I mean, I cut my teeth on map-reduce with mongodb, and it seems most other nosql solutions there are going that route for complicated things their standard query engine can't support.

shuzchen··on Show HN: Finally, You Can Accept Pre-Orders after Kickstarter with Celery
No, you can create a customer token and that token will forever refer to the credit card details the user entered. The only way you could consider that they "expire" is if the card as-entered expires, or if the user cancels that card. But even in this case your token still works, it just points to data that isn't valid anymore.

Unless celery does anything else on top of this (auto notifies customers if the cc expires in the interim, provides them a way to update details without you needing to do anything) then I don't see any compelling reason to use it.

shuzchen··on Django 1.5 released
I've used pretty much all of the major python frameworks in a professional capacity, and have also dipped toes into the RoR world as well as the various php frameworks. Django isn't "the one true way" - I've been known to reach for Tornado often - but it certainly works (ORM, templates, middleware included) for the majority of projects I've undertaken, and I've had success advising others to adopt it.

Also strange to hear that Django has a unique style of MVC, it seems pretty standard to me (and from what I see a lot of new frameworks are aping it).

shuzchen··on How I learned to love rebase
I personally don't subscribe to the "you should never rebase commits that you have pushed to a public repository" tenant. For me it's more "you should never rebase commits that you have pushed to a repository other people use".

That is, your personal WIP branches are fine, so long as you're the only person that pushes/pulls from it. These WIP branches should be labeled in such a way that the team knows at a glance which are WIP.

This also means your team members need to get used to doing a `git push -f`, as well as making sure their push.default is configured to "current".

shuzchen··on The MS Surface Pro
Yeah, I had a tablet computer back before Apple redefined what tablet meant. It was a Fujitsu machine and OneNote with a wacom pen was definitely a really nice way to take notes in class.

However, while I am excited by the machines that are coming out nowadays (surface pro, thinkpad helix to name a few) that will give me both the tablet and laptop experience, I'm dismayed that they're going the way of apple in terms of not giving us access to replace the battery/switch out drives/upgrade RAM on our own. If someone put a door on the backside of a thinkpad helix, I'd buy it for sure.

shuzchen··on TOML, Tom's Own Markup Language
I agree, and high quality YAML parsers are generally available in every language one might want to use. I don't believe I've ever encountered a situation where I was unable to obtain one. Well rust comes to mind, but then rust is really young and you could probably make one easily by just wrapping libyaml. That said, I might just write a TOML parser in python just for kicks.
shuzchen··on If you ever feel alone in this...
Not to downplay the value of therapists, but the help that a therapist could provide is different then the help one might find from a peer/colleague in the same industry/situation. the problem is therapists are always available (well, for a price) but a peer that you can trust with the same sense of confidentiality is rare.
shuzchen··on Thrown Off a United Airlines Flight for Taking Pictures
Obviously they didn't believe he was a terrorist or they would not have booked him on another flight.
shuzchen··on Vim After 11 Years
re: git changes, after seeing such a plugin for sublime (https://github.com/jisaacks/GitGutter) I went ahead and implemented the same thing for Vim (https://bitbucket.org/sirpengi/iwilldiffer). The plugin is still in beta status yet with compatibility, and I should make it easier to install with the various plugin managers as well as make the feature async (right now, the UI blocks waiting on the diff command). But otherwise, I'm using it daily and it supports mercurial as well as git.
shuzchen··on We are 2 Italians, in Treasure Island, and we are launching CoffeeStrap.
If there's a feature you know isn't working ("apply with twitter"), why have it up there in the first place? At least, please have it so that clicking on it leaves my form fields intact. I know I spent only 20 seconds filling it out but that was annoying.
shuzchen··on Errors vs bugs and the end of stupidity
The premise still applies in this case. If a student consistently has poor performance in piano and you can attribute that to lack of motivation, then that would be the bug (contrast with the notion that the student is stupid or bad at piano). If you can fix that one bug, you stand to gain a whole range of performance improvements.
shuzchen··on Syncing and merging come to Bitbucket
Github also does not have side-by-side diffs, and lacks hg support. I do wish Bitbucket would make a gist ripoff though.
shuzchen··on KDE 4.10 has been released.
Those of you on fedora can get the latest by adding the kde-redhat repo here: http://kde-redhat.sourceforge.net/ You'll need to temporarily enable fedora-updates-testing and upgrade systemd before upgrading the kde packages (at least on F18), but otherwise it's been stable for me.

No clue what state that's in, but I believe you can get it in ubuntu 12.10 at https://launchpad.net/kubuntu-ppa

shuzchen··on Delusions that companies have about the cloud
Are you considering you loss of time/freedom in that cost analysis? I get that cloud doesn't always make sense in every situation, but in a lot of cases people don't take into consideration these other factors (loss time managing/maintaining hardware, actual hardware costs, etc) when making the decision.
shuzchen··on Delusions that companies have about the cloud
Unless you also run and operate your own datacenter, the number of people you implicitly trust is fewer but still roughly the same as with a cloud provider. There's all the datacenter security personal, network and hardware technicians that could all possibly be "rogue".
shuzchen··on Amazon, Apple, and the beauty of low margins
From the article, the argument isn't that Apple is hurting, but it's market position is weak against newcomers because there are many vectors to compete on. While it holds a very strong position now, it's very conceivable that some brand can come up and compete on all aspects of design, quality and price.

Amazon then, can be considered to have a more stable position because newcomers cannot beat them on price, but merely match them.

shuzchen··on Belkin Buys Linksys from Cisco
I wouldn't call Meraki a consumer product though. Their cheapest AP is $400 and you have to buy per/AP license at $150/year. Not something I'd put in my parent's house.
shuzchen··on I Support the WebKit Monoculture
I can understand where your argument comes from but in my experience with the web developing for webkit+gecko+(whatever powers opera) is pretty painless. It's only adding IE in the mix where things get hairy. I generally just build solely in chrome, and things end up fine when i test in firefox/opera. In the rare case where something is different, the dev tools help narrow down the issue quickly. Contrast this with IE which often breaks and has horrible tools. If we could get rid of IE, I really would not mind having to support the remaining browsers.
shuzchen··on Why you shouldn't do what Aaron did
As an agnostic, I've found that the philosophy of social contract works well to explain where values/morals come from.
shuzchen··on Rant: Backbone, Angular, Meteor, Derby
Straight from the backbone faq: "Backbone.js aims to provide the common foundation that data-rich web applications with ambitious interfaces require — while very deliberately avoiding painting you into a corner by making any decisions that you're better equipped to make yourself."

I think the problem is people come into Backbone.js thinking it's a full fledged MVC framework for in-browser apps, instead you should think of it as a minimalistic set of tools with which to create your own framework (and in fact, a few actual frameworks have been released that are built on top of backbone.js).

One way to taxonomize frameworks is on how opinionated it is - Backbone.js is on the far end of the unopinionated side. If that's what you like, then Backbone.js is for you. If you want something more out-of-the-box, you should be considering the other options.

shuzchen··on Show HN: My weekend project - Codestagram
This project is missing one major, necessary feature: direct submission from your IDE/editor of choice. Creating a write-enabled API is probably the first step towards that.
shuzchen··on Rails is omakase
Sure, in terms of features either available in core or through third party gems/apps, both Rails and Django are pretty much on parity. You won't find anything worthwhile in the Rails world to tout over Django, since there probably exists an equivalent (or if not a port is soon to appear). Likewise, this works the other way around.

What makes me personally prefer Django is the approach the developers take, which when compared to Rails is more conservative. If something is to change in Django, the old way generally gets marked as deprecated a few version prior, and changes are introduced to have limited impact. I mean, even when Django changed the base directory structure of a new project they made sure that old code with the old directory structure would still work in most cases.

For the new url template syntax in 1.5 (they changed it to fix an inconsistency with other tags, as well as to support a new use case to allow variables as an argument), a from-future fix was introduced early on (in 1.3 even!) so that people with slow moving projects could safely ignore the problem until they could get around to fixing it, while people with fast moving projects can adopt the new "correct" behavior early.

Not to say incremental upgrades are always painless, but the pain is limited and well documented. Things that can be introduced on the users schedule (like the new url template syntax), are.

In some ways, that could end up being a disservice. Django can't move as fast or change as much as Rails can. But really, that's what you signed up for. If you bought into Rails and now you're mad that the floor is moving, you really should've considered that in the first place. Likewise, if you bought into Django and you wonder why it doesn't have ZOMG coffeescript (or whatever) as a default, then you probably should have considered that. Personally, I'm okay with Django core moving slowly, because I can augment it with reusable apps that are able to move a lot more quickly.

You also don't see douchey posts from the Django developers. They generally show respect for competing frameworks, and aren't afraid to be critical of their own. There's a lot to like here.

shuzchen··on A web-wide moment of silence for Sandy Hook
At first glance I'd think this was illegitimate. I mean, you expect people to deploy this before tomorrow, and the script tag isn't ready yet? Sure, I'll let you harvest my email address. If it weren't for the fact that this was created by the people behind causes.com, my alarms would be ringing.

Project creators should probably take some direction from sopablackout.org, or even modify the sopablackout snippet (it's not hard to do) to suit their needs. Since the users will be linking to an external resource, they can install it as soon as possible (and should, if they expect to have as many users as possible) and updates can be pushed out behind the scenes.

(disclosure, I'm responsible for the js snippet on sopablackout - yes, if anybody wants to ping me with questions about how it works I'm available)

shuzchen··on Shortcomings in the Django ORM and a look at Peewee, a lightweight alternative
Is there a reason you didn't use SQLAlchemy, as that's what I turn to when I'm not in Django-land. It's also closer to a competitor to Peewee than Django's ORM is.

I mean, when I use Django, even though I could switch out the ORM, I'd be ditching a lot of freebies (integration with auth, forms, South, all the reusable apps in the wild). Thus, you really don't see people ripping out the Django ORM except in the very extreme cases. It also explains why it'll be really difficult to switch out the Django ORM, as there is just so much integration to rewrite and legacy apps to lose.

If I wanted/needed/was willing to reinvent all of that, I'd probably start with a smaller framework (like Tornado, Flask) where the only stable game - so far - is SQLAlchemy.

Thus, I don't think it's in your benefit to consider/advertise yourself a lightweight alternative to the Django ORM, as there aren't many folks looking for an alternative (and even though most people aren't 100% happy with Django's ORM the bar to competing is really high). Your users are most likely not using Django, and deciding between Peewee and SQLAlchemy.

shuzchen··on Psy Makes $8.1 Million By Ignoring Copyright Infringements Of Gangnam Style
Because your edit implies that Psy's success was solely on the merits of his music video and official marketing, and that infringing parodies were not able to dent that success.

The original (and the one I prefer) implies that Psy's success was due in part of the infringing parodies, because of the network effects created by these parodies.

shuzchen··on Dropbox Hires Guido Van Rossum
If you're pulling a pure python package (like Django, Tornado or requests) then you're golden on any platform python is available for. If you're pulling a python package that contains C bits (like PIL, msgpack-python) then you'll need the compiler toolchain and associated libraries.

Luckily, most such packages (the popular ones at least) can be obtained in other ways (PIL through a win only download, or get a pure-python alternative like msgpack-pure-python).

shuzchen··on Google Apps stops accepting free sign-ups
It's a lot easier to have your data be shared with the whole team. Otherwise, with a personal google account, sharing a document with a team requires adding each individual person to each document. There appears to be a feature of adding a group to a document, but for the life of me I can't figure out how to define groups, and even if it were possible it'd be a few extra steps to manage as well as to keep track of, since the document overview only shows "shared" but not the people/group it's shared with.

With a domain-specific account, it's easy to set a document to be shared with the group - added benefit is if you add a new user to the domain, she is automatically given access to those documents. Also, the document overview is much easier to manage since anything marked "shared" usually means teamwide.

I get what you're saying, everything can be accomplished with the still free personal google account, just it includes a constant daily drain on mental processing power.

shuzchen··on Microsoft's DroidRage Twitter campaign goes painfully wrong
I've actually seen a lot of successful twitter campaigns. Barack Obama has had a few good runs during the campaign (with #forward2012) and recently with #my2k to push his side of the fiscal cliff issue.

Any twitter campaign will have participants who try to hijack the campaign for the opposing view. However, Obama has a strong enough base (I mean, ~50% of voters cast a ballet for him, and he does have a stronger hold on the younger, more-likely-to-tweet demographic) participating to drown out the hijackers.

The problem with this Windows campaign (I mean, besides that they tried the exact same thing before and failed) is that they specifically preclude their most devout supporters from participating. Anyone who is a die-hard Windows Phone fan has probably switched to WP when it was first available, and some probably have never touched android (I mean, they might have held onto Windows CE - anybody remember that? - until the first WP came out). In addition, anyone already using the latest WP hardware has no reason to tweet in order to win a free phone they already own.

So given this situation where MS's strong supporters have no content or reason to tweet, guess who rises up to fill the dead space? This campaign failed because it was designed to fail.

shuzchen··on Google Apps stops accepting free sign-ups
Seems most of the people recommending alternatives are only thinking of email. I use gapps for my family, and we take a huge advantage of having a domain-specific calender and docs.
shuzchen··on Google Apps stops accepting free sign-ups
That's $50/year for each user. Easy to stomach if it's only yourself, but add even a partner (not to mention a small team with a bootstrapped product) and it starts to make less sense financially.
← PreviousPage 8 of 13Next →