HNHacker News
TopNewBestAskShowJobs

vicaya

365 karma · joined August 24, 2007

hn@vicaya.com
submissionscomments
vicaya··on Why In-Person Socializing Is A Mandatory To-Do Item
This is probably true for many people. But some of the best work in history was produced exclusively by people in solitude. In fact, without thinking in solitude first, most people cannot have meaningful in-depth conversation with people in person.

I'd say that solitude (away from all (including online) social interactions) is also a mandatory to-do item once in a while. Just as in-person socializing, it's easier for some people than others.

vicaya··on Ask HN: What is the state of the art in OOP?
Focus on interface rather than object.

Embrace explicit state with state machines and events.

vicaya··on Strong opinions, weakly held.
People should only have strong opinions because they have convincing evidence. The point of the statement is that despite the fact you have convincing evidence from your perspective, you need to consider the possibility that your perspective is biased and that your opinions maybe invalidated as the problem scope and externalities evolve.

It's very hard to work with people with strongly held opinions, especially when there are more than one such people in your group.

vicaya··on Why moving to Scala - Part I - Writing less code
> entries = new ArrayList<Integer>() {{ add(3); add(4); }}

Nah, entries = Arrays.asList(3, 4);

Scala is pretty sweet with a lot of syntactic sugars, but it still it doesn't fundamentally make writing correct code any faster, especially for Java developers who are competent with their IDEs. Until Scala's compile time and IDE support improves 10x, I see no point of using Scala for production code.

Slightly more verbose Java syntax is more than made up by the instant/incremental compilation/autocompletion/refactor that works. Even as a Java noob (I'm more experienced in C++), I can bang out correct code the first time without going through any edit/compile cycles, most of the time. IDE is the new REPL and language snobs always forget that.

vicaya··on A C Heisenbug in the wild
I don't think so. At least 4 companies' codebase have their own assert/contractual macros specifically for this reasons. Such code will never pass a cursory review at these companies. This is a C-noob bug, IMO.
vicaya··on Why Java folks should look forward to Scala
When I was just starting to play with Scala 5 years ago, I found a lot of stuff that's "cool/neat/tight/convenient", I've since watched the language grow into a monster that's trying too hard to be Java++. The xml embedding syntax that looked neat initially looks like an anachronism now.

The result is a Java++ that's worse than C++. It slows down compilation 10x and makes proper tooling (IDE support) 10x hard, while providing no performance advantages. In C++, you can often get nice abstraction idioms (mostly due to template (partial) specialization, SFINAE) with zero performance penalty.

Java folks should just enjoy the superb IDEs (not just 1 but 3) and look forward to Java 8 or something like that (pending the Oracle issues), which will have a reasonable closure implementation ((JSR-335 looks OK to me), which would make much of the user (vs library/framework writer) side verbosity go away.

People use Java because its stability, compatibility and ecosystem, so C# wouldn't be a viable choice for them but an interesting thing to watch and learn lessons from.

vicaya··on Linux 3.0-rc1 is here
Well, Chrome must be broken then, as it's a validated HTML 5 page. It works with FF with noscript (with the domain blocked). Frankly, I have a hunch that people who care about javascript security don't use Chrome.

No chrome until noscript.

vicaya··on MapReduce: A major step backwards?
The article is from 2008. Since then, the so called parallel DB goes no where, and Hadoop takes over the world.

The main problem of traditional (OLAP) DBMS in the era of big data is that ETL (Extract/Transform/Load) becomes the main bottle neck rather than complex queries, as big data is inherently semi-structured and noisy. MR is the tool to process big data.

vicaya··on Doozer: a consistent, highly-available data store from Heroku labs
"The only freely-available tool that attempts to provide both of these is zookeeper, but zookeeper is specialized, focused on locking and server management. We need a general-purpose tool that provides the same guarantees in a clean, well-designed package."

I think they dismissed Zookeeper too quickly without trying to understand it first. The zookeeper primitives (get/set nodes and their children) seems simpler and cleaner than doozer is client protocol, AFAICT. Zookeeper should scale better (especially for readers) than typical Paxos based systems as well.

vicaya··on Programming Language Framework Traction on Hacker News
For a true lightweight modern web framework in Java that's based on Guice, checkout my little embedded web framework for the next generation of Hadoop.

https://issues.apache.org/jira/browse/MAPREDUCE-2399

No XML, no YAML, no config/properties files, no templates. Everything is statically checked by java compiler with instant feedbacks in an IDE. It's better than rails :)

vicaya··on Join Diaspora with these 25 simple steps (github)
hsqldb is more than adequate for a diaspora node. diaspora in a jar is completely doable and outperforms any rails/django setup.
vicaya··on 190,000 req/seq (micro benchmarks) ... Haskell webserver shootout continues
http://en.wikipedia.org/wiki/Amdahl%27s_law
vicaya··on IndexTank, a New Startup Offers Hosted Search as a Service
Congrats! Diego.
vicaya··on A Call For A Filesystem Abstraction Layer
No. The existing Filesystem abstractions conflate namespace APIs and storage APIs and handle both poorly. It's time to break'em apart!

What we need is storage atom/fabric APIs that provide individual namespace (tagging, hierarchical or whatever) and storage (dedup/sync/versioning/replication or whatever) components to enable applications to innovate UX for each domain.

In the next a few years, we shall see the passing of traditional Filesystem APIs and blossoming of new storage APIs.

vicaya··on Cloud Challenges for Databases: The Inherent Availability Problem
Annoying marketing piece devoid of any real technical content.
vicaya··on Things I've learned from hiring interns for IBM
More reasons to type on glass :)
vicaya··on Ask HN: Am I the only one who's not in love with Google Instant?
It doesn't impact me as I use https://encrypted.google.com/ (automagically via the wonderful HTTPS Everywhere firefox plugin.) which doesn't have the instant feature turned on by default.

OTOH, it's a very smart move for G from technical POVs, since their cache hit rate would be much higher as the queries are normalized in greater portion, so that the real impact on their backend is small in comparison (of the overall search volume.)

vicaya··on Productive Programming
uh, the -g compiler flag to enable debugging will create much more disturbance than a few printf ever could, debuggers are mostly useless for tracking down race conditions as they change the timing completely. OTOH, I'd use a low overhead logging package instead of printfs.
vicaya··on Why isn't Haskell popular in industry?
You know, it'd be more convincing if you can come up with reproducible benchmarks to backup your claims. According to This guy's data: http://www.codexon.com/posts/debunking-the-erlang-and-haskel... Haskell is even slower than python (which is not known for its speed) for implementing simple servers.

Haskell code that performs close (within an order of magnitude in terms of run time and space) to its C/C++ equivalent typically is also close in code length (and often less readable!) and often unsafe as well (requires explicit unboxing etc.)

vicaya··on The Evolution of Writing (by the founder of the first Rails host)
Informative, but should really be called "The Evolution of Writing in Italic and Germanic Scripts" (only one obligatory reference to an ancient Greek example and no mention of many other Indo-European scripts (say Slavic, which includes Russian etc.), let alone any Eastern scripts (CJK, etc.))
vicaya··on Use Chrome like a pro
Sorry, but real pros don't use Chrome.

No chrome until noscript, period.

vicaya··on Why you should never use a CAPTCHA
The strength of Bayesian filters is that they tailor to individuals, i.e., everyone can have a different model. An open source "well-trained" one is trivial to subvert.
vicaya··on American Professor to Chinese PhD Student: Go Make Money instead
Ever heard of EB1? Any PhDs (including candidates) worth their salt (have a few journal papers and good recommendations from their professors) can do it easily with some help from decent immigration lawyers. EB1 has no quota and waiting time (for priority date to become current). It's the fast track for these people.
vicaya··on Xz
It really depends on the data. For highly redundant data like web pages with lots of boilerplate header/footer, it can compress better because the bm_pack (first pass of bmz) looks for large common patterns over all the input. For typical text, it should be a little worse than gzip but faster.

BMZ = bmpack + lzo by default and can be combined with lzma if necessary. It's not really a BMDiff and Zippy clone, as I've never had a chance to see Google's implementation. It's based on the original Bentley & McIlroy paper: "Data Compression Using Long Common Strings", 1999. Even the two pass idea is from that paper. It was really a wacky experimental implementation (with a lot of room for improvement) to satisfy my curiosity. I'm a little surprised that the 0.1 version has been stable for quite a few people compressing TBs of data through it.

vicaya··on Firefox 3.6.4 with Crash Protection Now Available
+1 firefox. I've been resisting Chrome because they don't care about script blocking API.

No chrome until noscript!

vicaya··on Paths to $5M for a startup founder
That's why it's important to know about 83b election to cap the tax rate at 15%. Any start-up lawyer/law firm worth its salt would do this for you as part of the pile of forms to sign when you incorporate.
vicaya··on Paths to $5M for a startup founder
I'd assume all founders would know about 83b election (us founders anyway.) to cap the tax rate at 15% (long term capital gain)
vicaya··on How I sped up my server by 6x (with 1 linux cmd)
He should really be using dstat (or something like that) to show number of context switches per second.

His benchmark is mostly a measurement of Linux kernel thread context switching, which is a lot slower across cores/cpus. I suspect that if he tweaked the Linux kernel HZ to 1000, he'll see another 3-4x improvement.

In most real world servers, the threads are actually doing something real like updating some complex data structure and doing some transformation (encoding/decoding.), etc., which would made context switching overhead less of a problem.

However the benchmark does illustrate the importance of context switching performance for certain workloads.

vicaya··on Github: Interesting Repositories
I'm interested to see their interesting algorithms to determine interesting repositories.

It's obviously not based on the numbers of watches and forks.

vicaya··on Cloud MapReduce - a fast and lean alternative to Hadoop on AWS
The performance evaluation vs Hadoop looks bogus to me. S3, SQS and SimpleDB run on real (non-virtualized) hardware. You need a lot more Hadoop nodes to make it comparable. At least throughput per AWS dollar should be reported.

The ~100k files inverted index test is completely unfair to Hadoop: launching 100k map task per small file is ridiculous as it's basically measuring JVM startup time. People/crawlers typically put all these pages in large map/sequence files. Hadoop would automatically launch a map task per chunk (default 128MB).

Fetching data to EC2 for computation is also a step backward. It cannot scale on large data as the cluster will become switch bound much ealier than the "kosher" map-reduce, where data locality is observed.

In any case, it's neither fast or lean (it's basically Java glue code to use S3/SQS/SimpleDB, and seems to have larger overall carbon footprint than Hadoop)

← PreviousPage 4 of 9Next →