HNHacker News
TopNewBestAskShowJobs

danielecook

636 karma · joined July 22, 2016

Here is a useful site I built: http://www.hntrending.com

[ my public key: https://keybase.io/danielecook; my proof: https://keybase.io/danielecook/sigs/fmxN1m8INHaWQOZUHDloBzwtH7-3yeAD33ZCTFnjtnQ ]

2688d4dbdddca1e4423286cffb82193b81dfc5f7dfdbdc81c2bd73fc0a7b056e

submissionscomments
danielecook··on Nim 1.0
I stumbled onto nim because a sequencing-data (DNA/RNA/etc) library was written for it (https://github.com/brentp/hts-nim). In addition to Go, it's been a great way to learn a compiled language. It's fast, easy to use, and has a friendly community.
danielecook··on Pure Bash Bible
My mistake - I managed to completely misinterpret what you meant. I agree with your comment!
danielecook··on Pure Bash Bible
I don’t think it’s pomp. Once I learned Unix pipes and the tools for manipulating data (sed awk cut etc), it just became much faster and easier than writing python scripts that do the same thing. You can literally connect the output of one process to the input of another with a single character. It’s much more complex in python.

It also tends to be very portable.

danielecook··on Capital One Cyber Staff Raised Concerns Before Hack
To this day I still receive emails for another person with my name through cap one 360. Some were regarding overdue bills, and with others some personal information was given. I called repeatedly... and nothing was ever done about it. I think they poorly merged account data at one point - perhaps it’s a broader reflection of their IT work.
danielecook··on Speed matters: Why working quickly is more important than it seems (2015)
Efficiency is also more important than it seems. You can have lots of low quality, half-baked output. How much forethought do we put into what we will work on to begin with? Some projects and ideas are not worth the effort. Or an alternative solution to a problem is preferable over one you’ve been hammering away at for days, and would be easier to implement.

And in the realm of programming, it’s often easy to take shortcuts even though later on they wind up costing more time for you or others involved: omitting documentation, not making something reproducible, poor code quality, etc.

Having spent most of my career in academia I see a lot of the work makes this trade off: efficiency is sacrificed for a sloppy, immediate “speedy” solution. You need to find a balance and think through problems, considering not only what is immediately in front of you but also what you’ll be doing in a month or year. Otherwise you’ll wind up with a project or codebase that begins to drag your productivity and output with it.

danielecook··on Ask HN: Who wants to be hired? (August 2019)
Location: London

Remote: Yes

Willing to Relocate: No

Technologies: Bioinformatics, NGS, Bash, Python, Nim, Docker, SQL, Redis, Flask/Web

Resume: https://github.com/danielecook/cv/raw/master/cv.pdf

Email: danielecook at gmail dot com

danielecook··on Slack was down
Seems like an open-source self-managed solution would be preferable at this point.
danielecook··on Wind is outpacing coal as a power source in Texas for the first time
And the smell. Describe the smell for us.
danielecook··on Launch HN: Wren (YC S19) – Offset Your Carbon Footprint
Not sure how you will provide updates but I think satellite imagery over time would be really neat for reforested areas.
danielecook··on Guix Workflow Language
The two main things you want out of a workflow language are re-entrancy and a DAG of job dependencies. Re-entrancy is the ability for the workflow to pick up where it left if something crashes (basically via caching or detecting the presence of expected output files). The DAG is a directed acyclic graph of job dependencies: First do A, then B, then C. The DAG is worked out by the workflow manager, and jobs can be managed accordingly.

A good workflow manager builds on these ideas further by managing environments, job submission, parallelization, cloud/cluster submission, and other options that make processing large amounts of data a lot easier and more efficient.

danielecook··on Guix Workflow Language
For bioinformatics, take a look at Nextflow. I personally think it is miles ahead of the competition having reviewed about a dozen options out there.

This looks useful, but can it submit jobs to cloud compute clusters or HPC systems and operate locally? Maybe I’m missing the point in terms of the purpose.

danielecook··on How much free time do you have?
A few ways to get more free time:

- combine commuting with working out. Even if you only run 1/2 way and still have to catch a train for the second half you’ll still be getting time back. - hire a cleaning service if you can afford it. Maybe a Roomba? - move closer to work to reduce your commute time. - don’t keep your phone by your bed. If you are like me you’ll waste time in the morning and evening. - don’t make more chores for yourself than necessary. For example, you can often wear pants 2 days of the week without issue.

danielecook··on Show HN: DICOM Medical Image Parser in Go
Thanks! Lots to learn here.
danielecook··on The side of Paul Allen I wish more people knew about
is there a list of these kinds of businesses out there? What is your business gonna be?
danielecook··on Show HN: DICOM Medical Image Parser in Go
So I may be working with DICOMs in the very near future and know nothing about them. This seems like it will be helpful to me. Where can I learn more about the format and how to use it?
danielecook··on The side of Paul Allen I wish more people knew about
It can be very tough to get ahead in science/academia without that laser focus, unfortunately.
danielecook··on The side of Paul Allen I wish more people knew about
I think the most important thing to optimize for is time. Move closer to work, get a roomba, buy a second monitor, etc. For me anything I can do to get extra time is a huge payoff because I'd rather spend my time learning something new, cooking, traveling, or cycling/running.

I recently switched jobs and am moving next month to reduce my commute. I'll have an extra 7 hours a week to do whatever I want and I cannot wait.

danielecook··on Using AWK and R to parse 25TB
Here is an alternative solution, although yours is a good one.

If you only need a single SNP or a group of SNPs within a region, you can use tabix[1] to index gzipped TSVs and query by genomic position. The position of SNPs can be obtained from a lookup table (2.5M is not very big even for R) or from an API if you were to say - query by rsid.

tabix also works over http (and s3) and can utilize RANGE queries to select a subset of a file...so you only wind up downloading a or reading a small portion once it is indexed and can do something like this:

tabix https://www.file.url.tsv chr1:1-1000

The command above would return variants on chromosome 1 between 1 and 1000.

The following variant browser works in this way: https://elegansvariation.org/data/browser/ - Theres no formal database (e.g. MySQL) running here, just tabix (actually bcftools which uses tabix) to select variants in a particular region, wrap them in JSON, and return to the client.

Setting this up on S3 requires configuring CORS... the igv browser also uses tabix indexes and provides guidance on how to set this up [2]

[1] https://www.htslib.org/doc/tabix.html [2] https://github.com/igvteam/igv.js/wiki/Data-Server-Requireme...

I created a similar solution to what you have done using this alternative approach, writing a wrapper in R that invoked bcftools under the hood. The dataset I was working with was a lot smaller (1.6M Snps x 252 individuals), but should work with larger genotype sets as well.

danielecook··on Calgary student has been studying decibel levels in hand dryers since age nine
I hate that thing. It's so loud. I refuse to dry my hands with it.
danielecook··on A Learning Secret: Don't Take Notes with a Laptop (2014)
I take great satisfaction in filling a notebook from cover to cover though. I do look back at old notes, although it is quite rare.
danielecook··on From Python to Go to Rust: an opinionated journey (2018)
I went from python to go to nim. Actually I still like go - but nim is an easy transition from python.

I think nim is the best thing out there for building tiny CLI utilities. It’s a fun language to code in.

danielecook··on Ask HN: What can I do to accelerate scientific research?
Definitely. A lot of work is done in R or python and could be sped up in a compiled language.
danielecook··on Couple wins millions using lottery loophole
Love hearing stories like this where people gained because of some loophole. Does anyone know if there is a compilation somewhere of these?

See also:

https://www.businessinsider.com/us-mint-ends-the-dollar-coin...

danielecook··on I Grew Up Gifted, but My Life Didn’t Turn Out the Way I Expected
Glad you figured things out - but I’m very curious about what you switched to.
danielecook··on Google – My Location History
I look at it more through a behavioral lens. If you know a lot about someone you can use that information to modify their behavior and decisions. I'd prefer to minimize behavioral triggers like and retain more influence over my own destiny.
danielecook··on Google – My Location History
I like it as well - but google is almost certainly using this data to target you. I also wish I more control. Is there a way to export to GPX? It would be fun to create a heat map of your daily locations over the course of years.
danielecook··on Ask HN: What are your other favorite communities other than Hacker News?
Can I get an invite? danielecook at gmail dot com
danielecook··on The Art of Command Line (2015)
Here is a function for mac os that outputs a pdf of a man page

    function pman() {
        man -t ${1} | open -f -a /Applications/Preview.app
    }
danielecook··on Washington state lawmakers approve human corpse composting
From a very young age I’ve thought cemeteries were ludicrous. It’s nice to be able to remember a loved one, but after a few hundred years is it still necessary? The fact is after a certain number of generations no one is grieving or remembering or even visiting the cemetery plots. In a nearby graveyard in London the gravestones are so old and space is so tight that they moved them all out of the way to make room for a playground.

Who am I to feel so important that I should take up space in perpetuity?

After a few generations, document the gravestones and get rid of them and make room for a park you can run around in.

danielecook··on Technical Debt
> Legacy code isn’t tech debt either: it was right for the time.

Doesn’t this assume that code as written was of the highest quality? Under tight deadlines or misaligned priorities code quality suffers. Even if it works or “is right” doesn’t mean it wasn’t done to a standard that maximizes productivity.

← PreviousPage 3 of 6Next →