HNHacker News
TopNewBestAskShowJobs

sakai

1 karma · joined August 17, 2024

submissionscomments
sakai··on Bloom Filters by example
The latter - probabilistic in the sense of having a defined error rate. In one of our use cases, the keys are simply kmers and the values are organism or gene IDs.
sakai··on Bloom Filters by example
I'm only familiar with a Python clone of the Cassandra implementation ("hydra" -- used it a while back), but two issues I do remember are: 1) I believe it only uses 32-bit ints for the bit array addressing, so you can overflow it (and this also may be less-than-ideal from a hash distribution perspective, but I don't know offhand); and 2) as someone coming from a different background, I found the whole thing to have a bit too much "OO" magic, with several helper classes to set up the filter that (to me) obfuscate what's really going on.
sakai··on Bloom Filters by example
Very cool – I hadn't seen this paper before (haven't done any real work on de novo assembly or otherwise requiring de Bruijn graphs).

Here's a paper using Bloom filters in metagenomic classification (my relative* area): http://bioinformatics.oxfordjournals.org/content/26/13/1595....

In this vein, a friend and I are researching/implementing a probabilistic key-value store for some bioinformatics applications (one is metagenomic organism and gene identification). It's fast and space-efficient, just like a BF (though obviously less so as it stores keys and not single-set-membership). Any use cases for that kind of thing in your sub-field? Always trying to figure out interesting new applications (we aren't ready to write it all up yet, but hope to at some point not too far down the road).

* I'm really just a dabbler / don't have a formal bioinformatics background. My friend is the genetics PhD.

sakai··on Ask HN: What are you working on and why is it cool?
A friend and I are developing a new fast, space-efficient (read: probabilistic) key-value store. We're using it for some computational biology applications.

It's cool because: * It scales to really large data sets: We store ~10 billion keys in memory on a single, not-too-ridiculous machine, and the design supports sharding trivially * It's fast: we have a lot of optimization still, but can do ~1M lookups/sec (O(1) lookups) * It's a data structure! (Which as non-formal-CS people we find fun)

Would be very interested to hear other applications that people would find the above attributes useful for!

sakai··on WhiteDB – Lightweight NoSQL database written in C, operating in main memory
Does anyone mind sharing what they see as the advantage of this vis-a-vis a Redis, LevelDB, Mongo, etc. (realizing those are all very different)? Is it principally read throughput, write throughput, interfacing, space efficiency, scalability to very large datasets, or something else?

I ask as friends and I are doing research into very space-efficient (read: probabilistic) key-value stores. We have a few scientific use cases, but I'm curious if others would find the ability to scale to very large key- and value spaces (~1e9+ key-value pairs) in a space efficient way practically useful. Or, if interest is principally academic.

Apologies for the (pseudo-)hijack.

Ps. Looks very interesting, I have it on my to-dos to install and check it out more deeply.

sakai··on A Big List of D3 Examples
Ugh, I clicked a few of the earthquake examples (did a similar viz in the past) and saw that none of them was working.

Then looking at the curl responses one gets, "Due to the Federal government shutdown, usgs.gov and most associated web sites are unavailable. Only web sites necessary to protect lives and property will be maintained."

One can only wish they saw these and similar APIs as important infrastructure that needs to remain functional.

Otherwise -- this is very helpful! Thanks so much for assembling the collection.

sakai··on Snow HN: Choosing a name for your project is hard. This makes it easier.
Another perspective -- since red and green are very universal colors for success/failure, stop/go, etc., you could also choose to keep the red and green colors but change the dots to a checkmark and X glyph (or similar).
sakai··on Two New Books About Jorge Luis Borges
Ok. See it now. I was confused seeing that as the title -- but don't need to weigh in on the whole HN perennial titling debate.
sakai··on Two New Books About Jorge Luis Borges
Where is the reference to 14 pages in the article? (Think I read the whole thing and didn't see it, but I am on my phone)

Edit: Note: The title a moment ago was something like "Borges never wrote a work of fiction longer than fourteen pages"

sakai··on Coursera-dl – A script for downloading course material from coursera.org
Hmm, I'm not that familiar with BeautifulSoup, but it appears to not properly be parsing the page, rather than a download / availability issue. Specifically, there's no content in the soup object ~line 150 and thus the list of content to parse and download is just [].

Will keep probing, but if anybody has experienced something similar and has a handy solution, I'd greatly appreciate the tip! (And I'm sure the author would appreciate a PR)

sakai··on Coursera-dl – A script for downloading course material from coursera.org
Anyone able to get scicomp-001 to work? I get this warning: "Warning: no downloadable content found for scicomp-001, did you accept the honour code?" (I have)
sakai··on Show HN: Upboat, idea validation with a twist
Agreed -- but for 24 hours, the design is pretty good too!
sakai··on Vector Tiles for MapBox Streets
As always, very beautiful work. Congratulations and thank you for contributing this back to the OSGEO community.
sakai··on Show HN: Felt – Personal, handwritten cards mailed from your iPad
Follow-up: And how are you sourcing your card designs? I know a few artists who I'm sure would love to talk to you.
sakai··on Show HN: Felt – Personal, handwritten cards mailed from your iPad
Quick question: Are the cards at the bottom good examples of how your printer will render the handwriting (and were they made with or without a stylus)?

If so, bravo -- they look great!

sakai··on Fertilizer that fizzles in a homemade bomb could save lives around the world
"... where diplomacy would be more suitable."

What do you mean by that?

sakai··on Google Search Terms Can Predict the Stock Market
Sure, but that's not likely the meaning in the average Google search term with the word "color" (or whatever exactly is being displayed here).
sakai··on TokuDB open sourced
Can someone in the know elaborate on the current state of US patent law here? And what exactly TokuDB / the universities hold a patent on?

Curious outsider here, and understand that all IANAL caveats apply.

sakai··on Scribd hacked – emails and hashed passwords leaked
I'd like to echo this concern -- were all emails/encrypted passwords leaked, but you only consider those protected by outdated hashing schemes to be compromised?

If so, I feel you have an obligation to alert ALL of your users.

sakai··on Data-Visualization Firm’s New Software Autonomously Finds Abstract Connections
How does this differ from Quid's offering? (http://www.quid.com)
sakai··on North Korea’s First Computer Game: Pyongyang Racer
Umm... that's quite simply false. Between 1994 and 1998, somewhere between 240K and 3.5M people died from famine in North Korea (of a total population of ~20M).[1] And while it's possible that there are similarly arduous conditions in China, the Philippines, Thailand, and (even) the US, the average citizen is certainly better off in all of those places.

To put those famine figures in perspective, that's roughly the equivalent of half of California perishing from starvation during the mid-1990s (at a national scale -- if you prefer to think at a more regional scale it's like losing SF from the Bay Area).

[1] See http://en.wikipedia.org/wiki/North_Korean_famine for a quick overview

sakai··on Map: The most and least corrupt countries in the world
Well, to put it into perspective, they joined during very different political and economic times: the Danes in the late 60s and the Swedes and Finns right after the Wall came down.

Edit: Looks like Denmark applied in 1969 and was admitted in the early 1970s.

sakai··on The YC VC Program
Looks like it: http://www.crunchbase.com/financial-organization/maverick-ca...

Edit: NOT Mark Cuban.

sakai··on Why an Airline That Travelers Love Is Failing
Still working on that problem...
sakai··on Free Ligature Symbols
I rather like this too, as they degrade gracefully. It's quite elegant.

Does anybody know what support exists (or is required) for ligatures across common browsers?

sakai··on Lockitron exceeds $2,000,000 in reservations
Indeed :)
sakai··on Show HN: Weekend project, D3.js Globe of Recent Earthquakes
Haha, yeah that would be fun. Though it might get a bit out of control!
sakai··on Show HN: Weekend project, D3.js Globe of Recent Earthquakes
Hmm, sorry you're having trouble with it. The 'error parsing d=""' is an issue with the SVG parser within your browser, and shouldn't prevent it from rendering properly. I believe upgrading to the next version of d3.js will likely fix this.

It's possible that it's not properly loading the data for you, either due to latency or some browser restrictions. What are you running?

I'd like to debug if possible. I believe D3.js only fully works in Chrome, Safari, and Firefox (+ maybe Opera?).

sakai··on Show HN: Weekend project, D3.js Globe of Recent Earthquakes
I hadn't noticed that re-direct. Thanks and fixed.

All of the SVG magic is D3.js and simply modified from this sweet example by Mike Bostock: http://mbostock.github.com/d3/talk/20111018/azimuthal.html

Edit: Oddly, I'm noticing that the title of Mike's page is "Afghanistan", which is the one country in the GEOJSON I'm using that doesn't render properly... (it shows empty like a 2nd Caspian Sea)

sakai··on Show HN: Weekend project, D3.js Globe of Recent Earthquakes
It can / will be. I just have a really messy commit log as I was editing files from Github manually from another machine (not a good strategy...).

Email me at boyd.greenfield at gmail and I'll get you the source if you'd like to chat about it. Otherwise I'll get to opening it up and adding an (open) license shortly.

← PreviousPage 2 of 6Next →