HNHacker News
TopNewBestAskShowJobs

cottonseed

2,959 karma · joined August 22, 2011

email: <username first word> dot <username second word> at gmail
submissionscomments
cottonseed··on Ask HN: Any open-source project in need of a Technical Writer?
Yes! I was just thinking about this, actually. We're building scalable tools for analyzing genetic data on Spark:

https://hail.is https://github.com/hail-is/hail

It's tricky because we need someone who can write, has technical knowledge (python, Apache big data stack) and some knowledge of bioinformatics and statistical genetics. There might be an option for some paid work. What's the going rate for technical writing?

cottonseed··on Ask HN: What's the best computer science book you've read recently?
Lately I've been reading Network Algorithmics. Awesome book.

https://www.amazon.com/Network-Algorithmics-Interdisciplinar...

cottonseed··on Developer Preview – EC2 Instances with Programmable Hardware
No, Clifford is cliffordvienna on HN. He wrote Yosys (and amazing piece of software) and did the iCE40 reverse engineering (amazing work). I wrote the place and router, arachne-pnr.
cottonseed··on Developer Preview – EC2 Instances with Programmable Hardware
This is so awesome, I can't even. I wrote arachne-pnr [0] to learn about FPGAs to get ready for this day. Just signed up, can't way to play with these!

I hope the growing popularity of FPGAs for general-purpose computing will help push the vendors to open up bitstreams and invest in open-source design tools.

[0] https://github.com/cseed/arachne-pnr

cottonseed··on Ask HN: Have you ever thought of leaving programming for something else?
I left to get a PhD in math. Now I'm back, sort of.
cottonseed··on Ask HN: What are you reading this weekend?
Just finished Last Days by Brian Evenson and started An Everyone Culture by Kegan and Lahey.
cottonseed··on Ask HN: Ever been hired through a “who's hiring” post?
I made one hire through Who's Hiring.
cottonseed··on Brief History of Haskell
I'm surprised there's no mention of Id:

https://en.wikipedia.org/wiki/Id_(programming_language)

cottonseed··on Laws of Performant Software
> Abstractions are the enemy of performance.

I like to say "abstractions + compilers = performance".

cottonseed··on Command-line tools can be faster than a Hadoop cluster (2014)
Is there a place to download the database that isn't a self-extracting executable? (Seriously?)
cottonseed··on Command-line tools can be faster than a Hadoop cluster (2014)
I think you might be replying to my comment. We just took delivery of a 20K WGS callset that is 30TB gzip compressed (about 240TB uncompressed) and expect something twice as big by the end of the year. We're trying to build something pretty general for variant level data (post calling, no reads), annotation and phenotype data. Currently we focus on QC, rare and common variant association and tools for studying rare disease. Everything is open source, we develop in the open and we're trying hard to make it easy for others to develop methods on our infrastructure. Feel free to email if you'd like to know more.
cottonseed··on Command-line tools can be faster than a Hadoop cluster (2014)
We're analyzing genome sequence data on that scale: https://github.com/hail-is/hail
cottonseed··on Lessons Learned from Software Rewrites
When I hear about rewrites, I always think about this comment:

https://news.ycombinator.com/item?id=11554288

cottonseed··on Ask HN: Who needs contributors?
Hail

Github: https://github.com/hail-is/hail

dev gitter: https://gitter.im/hail-is/hail-dev

Starter issues (a bit sparse right now): https://github.com/hail-is/hail/labels/starter

Hail is a scalable framework for massive data analysis. It's written in Scala and built on Spark and the Hadoop ecosystem.

I'm a software engineer/mathematician, but we're embedded in a world-class genetics research lab. The first paper using Hail was put out recently:

http://biorxiv.org/content/early/2016/06/06/050195

with more in the pipeline. Hail is being used to analyze some of the largest genetic datasets out there (hundreds of thousands of exomes and tens of thousands of whole genomes). There's tons to do. Jump in or email me (see my profile) if you'd like to get involved. If you tell me what you're interested in, I will try to tailor a task for you. No bio knowledge needed.

License: MIT

P.S. We found one other contributor and our last hire through HN. So, thanks, HN!

cottonseed··on Using Apache Spark to Analyze Large Neuroimaging Datasets
If you're doing neuroscience image analysis, you probably want to take a look at Bolt, Thunder, Lightning:

http://bolt-project.org/ http://thunder-project.org/ http://lightning-viz.org/

and associated work going on at the Freeman lab at HMMI:

https://www.janelia.org/lab/freeman-lab

cottonseed··on Ask HN: Is there any use nowadays for a proprietary C compiler?
Yes, but you'll have to find a niche where gcc or LLVM don't make sense. Intel has a huge compiler group and insider architectural knowledge, and icc has a minuscule market share. I don't see a viable business targeting mainstream processors.

I was co-founder of a compiler startup that targeted high-performance, cost- and power-sensitive communications processors that were idiosyncratic and hard to program (e.g. split-phase memory accesses, explicit hardware threading and cache control, non-interlocked pipelines, massive SIMD and VLIW parallelism, etc.) Existing compilers for these architectures, if they existed, had abysmal efficiency of generated code.

I'm a little out of touch, but I don't know if this market exists anymore. I think the FPGA tool space is interesting and high-level synthesis tools is one direction to take compiler technology.

The other place compiler development makes sense is inside hardware companies doing new architectural development, e.g., Tilera, Adapteva/Parallella, etc. I ran into Andreas about a year ago and he said they were looking for someone to work on development tools.

You can think of query optimizers and schedulers for distributed computing clusters as the data center evolution of compiler technology in the Barroso, Hölzle warehouse-scale computer sense. I think there's definitely opportunities to innovate in that market. See, for example, the recent post about Baidu accelerating SQL queries with FPGAs:

http://www.nextplatform.com/2016/08/24/baidu-takes-fpga-appr...

cottonseed··on The End of Meaningless Jobs Will Unleash the World’s Creativity
Full text on Brain's site: http://marshallbrain.com/manna1.htm
cottonseed··on Successfully collaborating with computational biologists
Why from a distance?

We're building a framework for analyzing massive genetic on Spark:

https://github.com/broadinstitute/hail

I'm a software engineer/mathematician, but we're embedded in a world-class genetics research lab. The first paper using Hail was put out recently:

http://biorxiv.org/content/early/2016/06/06/050195

with more in the pipeline. Hail is being used to analyze some of the largest genetic datasets out there (hundreds of thousands of exomes and tens of thousands of whole genomes). There's tons to do. Jump in or email me (see my profile) if you'd like to get involved.

cottonseed··on What Is Knot Theory? Why Is It in Mathematics? [pdf]
One of my favorite mathematical diagrams: http://www-math.mit.edu/~andyp/Figures/FIGURE2.pdf, from Matveev, Fomenko, Algorithmic and computer methods in three-dimensional topology.
cottonseed··on The LHC “nightmare scenario” has come true
Relevant: https://www.youtube.com/watch?v=X9iZ9UN2KcM&list=TLQHZqksSCY...
cottonseed··on DLS, the digital logic simulator game
When I was a kid I played a game on the Apple ][ that years later I realized was secretly an introduction to digital design with propagation delay. In the game, little sparks/pulses would travel down wires, and there were various objects (primitive elements) that would manipulate the pulses (and gates, or gates, delays, relays, etc.) If memory serves, each level had a set of pulses that needed to be generated to progress to the next level. I have no idea what it was called and I've looked for it occasionally without success. Anyone know what I'm talking about?
cottonseed··on You Don’t Have “Plenty of Time”
Yeah! Fuck future me! http://www.pidjin.net/2013/10/24/future-me/
cottonseed··on Brewing Up a myStorm FPGA board on the kitchen table
I stand corrected. See Clifford's other comment in this thread.
cottonseed··on Brewing Up a myStorm FPGA board on the kitchen table
I didn't realize that. Thanks for clarifying, Clifford!
cottonseed··on Brewing Up a myStorm FPGA board on the kitchen table
Unfortunately IceStorm has only reverse engineered the 1K and 8K, not the 4K.
cottonseed··on Ask HN: List of technological breakthroughs through tinkering and perseverance?
As compared to?
cottonseed··on Algebraic patterns – Semigroup
As you say, most semigroups are just monoids where you forget the identity. Here's an MO thread on examples of monoids that aren't trivial restrictions:

http://math.stackexchange.com/questions/460/are-there-any-in...

cottonseed··on Ask HN: How often do you get contacted via HN?
I'm the opposite of the other answers here. Apart from a Who's Hiring post, once or twice in 5yrs? Essentially never.
cottonseed··on The Origins of SageMath; I am leaving academia to build a company [pdf]
Magma is closed-source.
cottonseed··on All the best advice we could find on how to get a job
Have you read Nick Corcodilos's Reinventing the Interview? There is a lot of overlap with your advice (understand the employer's problems, explain your value, etc.) Related to "Do free work", something I always liked, he recommends you actually do the work you're being hired for in the interview. How better to demonstrate how capable you are?
← PreviousPage 5 of 18Next →