HNHacker News
TopNewBestAskShowJobs

vicaya

365 karma · joined August 24, 2007

hn@vicaya.com
submissionscomments
vicaya··on Ask HN: Please review my concept
Is this a mylivesignature.com knock off?
vicaya··on Ask HN: Do you actively contribute to open source projects?
Core developer of Hypertable (http://hypertable.org/). Had patches accepted in Git, Reviewboard, Thrift, etc.
vicaya··on Ask HN: Do we (HN members) need a HN social network?
I think Twitter's model (following and followers) is appropriate for HN. The traditional friend model (friendster, myspace, facebook etc.) is ugh.
vicaya··on When are we going to stop writing code?
Once singularity is reached, our code will write themselves. We'll just sit back and enjoy a latte/beer/whatever.
vicaya··on Chart of YC companies' hosting decisions
google for 1and1, you'll see a lot of complaints there. I had a few bad experience with them. If your renew payment has some issue (mostly CC expiration date etc.) they'll immediately send the account to collection and suddenly your $6.99 or whatever domain becomes a lot more expensive. I refuse to deal with shady business like that.
vicaya··on Cloud Computing Makes Servers Obsolete
Cloud computing provides service abstraction at different levels.

You don't need to think about servers at SaaS (Software as a Service. e.g, Google Docs/Apps) and PaaS (Platform as a Service. e.g. Google Apple Engine, Windows Azure; Amazon S3, Elastic MapReduce etc.) level, but you do have (virtualized) servers when you need IaaS (Infrastructure as a Service. e.g. Amazon EC2, VMware infrastructure) where you need to put existing/legacy applications that have clear dependencies on explicit servers in the cloud.

vicaya··on Ask HN: review my startup Wiki-OS, the first webOS developed the wiki way
Call me old school, but I don't like having desktop environment in a browser (webtop sounds fine to me) to be called an OS. An OS is much more than that.
vicaya··on What's Wrong with Erlang?
Erlang is a quirky DSL for a seasoned actor system. That's my impression 10 years ago. It still makes sense now despite all the recent hypes.
vicaya··on RethinkDB (YC S09): MySQL Storage Engine Built From The Ground Up For SSD
I still think SSD is a mere diversion in storage. According to Jason Hoffman (CTO/Founder of Joyent, speaking on Structure'09), SSD under their typical workload can only last for a month before wearing out: http://gigaom.com/2009/06/25/structure-09-how-to-scale-up-wi...

Cheap commodity disks however have an annualized failure rate of 4% in Google's datacenter (according to their disk analysis paper.)

vicaya··on My Thoughts on NoSQL
99.9% web sites are CRUD, which don't really need full features of RDBMS, which is both an overkill and a bottleneck for scalability.

NoSQL is ironic word in that both Hive and Pig are gonna introduce an ANSI SQL dialect for scalable data queries :)

The NoSQL movement is really a NoBlindJoinsViaRDBMS movement, but the latter is less catchy.

vicaya··on Announcing release of HadoopDB
It's poor man's Vertica. Mostly good for analytics workloads.

It's quite strange that they didn't reference Bigtable paper at all, while saying "to the best of our knowledge, there exists no published deployment of a parallel database with nodes numbering into the thousands". Google had a dozen bigtable clusters with more than 500 nodes and at least one cluster with a few thousand nodes (for the main crawl db), more than 3 years ago.

vicaya··on Set Based Filesystem idea
Actually, you can write a wrapper in your favorite language around your favorite database and call it your favorite filesystem, which is really a CMS.
vicaya··on The software community has rejected the best research in compilers/languages
Well, one of the best research in compilers and languages, IMHO is applying static analysis and constraint solvers to practical systems (e.g. C) find bugs and/or automatically generate tests to find bugs:

http://www.stanford.edu/~engler/

Coverity is a startup from such research. The new Klee paper is a good read as well.

vicaya··on Ask HN: Would forcing everyone to know their IQ reduce overall ignorance?
Dude, these guys love analogies like: Astrology is to fortune as IQ is to achievement.
vicaya··on Japan Going to 10 Gigabit/s symmetrical internet access starting 2010
The "symmetrical" is the killer part. It makes peer to peer backup of large files (HD videos) bearable.
vicaya··on How SQLite Is Tested
Wow, astounding ignorance/ungratefulness on static analysis. Coverity (a static analysis tool) found many defects in the code (17 fixed). The number of defects per KLOC for SQLite is not that great compared with other projects. KDE is actually much better: http://scan.coverity.com/rungAll.html

Engler (whose students founded Coverity) et al. had an OSDI "best paper" last year on using static analysis (with constraint solvers etc.) to automatically generate test cases, which actually beats hand written test cases for glibc with years of development.

http://www.stanford.edu/~engler/klee-osdi-2008.pdf

vicaya··on Bing Vs. Google Comparator
search for "dvcs comparison" (unquoted). bing returns many completely unrelated dvd/spam sites, while google is spot on. MS still have a lot of work to do.
vicaya··on A Technical Look at Google Wave
It's entirely possible to implement a wave like UI over SMTP. Many mail clients already implement thread views etc. If you take a step further and implement a threaded diff view it's already fairly close to wave UI).

While I like the the shared/synced document object model, I'm not sure about the value added via a new/unproven protocol stack just for the per character gimicks.

"Real time" is overrated and not needed in many cases.

vicaya··on Scaling Memcached: 500,000+ Operations/Second
Read the facebook engineering notes on memcached. Linux kernel needs to be patched to fully utilize all cores even at 200k qps with 173ms average latency. Also you didn't give average request size and latency numbers, which makes your number less helpful.
vicaya··on Scaling Memcached: 500,000+ Operations/Second
A typical "drag race" benchmark. There is no latency numbers for the corresponding throughput. The facebook engineering notes was a little more helpful, with at least average latency 173ms at 200k qps with an intel 8-core box with 1GE NIC (they could push it to 300k but the latency was too high.) So a max 500k qps (with unknown latency) on a much more expensive T2 with 10GE NIC is not that impressive.

I'd like to see median and 99 percentile latency for any throughput numbers.

vicaya··on OpenID’s Tipping Point
Ubiquitous browser support so that the sign on interface is uniform and that phishing is impossible would go a long way for OpenID.
vicaya··on Benchmarking BDB, CDB and Tokyo Cabinet on large datasets
Sorry, but 500MB DB size is a tiny dataset these days (anything < 1GB is tiny, < 4GB is small, < RAM on a single node (~8GB-64GB) is medium, < Disks on a single node (~128GB to a few TB) is large, huge dataset requires multiple nodes and typically above 128TBs.)
vicaya··on The Cult of Done Manifesto
"Done" is overrated. It just gives you false/fake sense of control, which can be addictive.

Give it up. "Doing" instead.

vicaya··on CouchDB Bloom Filters
Bigtable (according to the paper), HBase and Hypertable all use bloom filters to improve performance of random reads. Here is some bloom filter test code in Hypertable to compare Jenkins' lookup3, Hsieh's SuperFastHash and Appleby's MurmurHash2: http://github.com/vicaya/hypertable/blob/4fce96592cab3fd6d0e...

MurmurHash2 is the winner in all cases I've tested.

vicaya··on Is Memcached a Good or Bad Sign for MySQL?
Memcached with UDP get can handle 400k gets per second (from a facebook engineering note earlier this year) on a single commodity server. Which "decent" DB can even approach this even for simple queries? A cache server and DB server simply have different performance priorities. Memcached makes a lot of sense for caching application specific fragments that has application specific expiration policies.

Regarding your 2nd point, latency != 1/throughput when you have parallel queries.

vicaya··on Can HN make the leaders page more useful by showing average karma per comment?
Why stop at average karma, we can also print a little histograms (sparklines) of comment karma, I bet the target audience of HN would love it :)

Another way for front-page ordering would be (total karma * exp(-beta * age)), you can tweak beta for time decay.

vicaya··on Ask HN: A good open-source implementation of multi-key-value db?
What you need is a full text search engine with faceting features. Solr or Sphinx should fit the bill.
vicaya··on Wolfram Alpha API (Google Cache)
http://www.wolframalpha.com/WolframAlphaAPI.pdf

works and more up to date (updated on May 14, 2009)

Looks pretty good.

vicaya··on Coding Horror: Why Do Computers Suck at Math?
He's the main developer of stackoverflow, which I think is pretty good compared with many other sites :)
vicaya··on Things You Should Never Do, Part I
Reuse is overrated and rewrite is underrated. It's true that typical first rewrite suffers from [second/sophomore system syndrome](http://en.wikipedia.org/wiki/Second-system_effect)

The only way to overcome that is to do more rewrites :)

← PreviousPage 7 of 9Next →