HNHacker News
TopNewBestAskShowJobs

kyllo

4,284 karma · joined December 5, 2012

Data Science @ Microsoft. Opinions expressed here are my own.
submissionscomments
kyllo··on Air pollution greatest global threat to human health, says benchmark study
Because it's a power law distribution and because wealth inequality is getting even worse over time.
kyllo··on Gradients are not all you need
Are you familiar with the edge popup algorithm introduced in "What's Hidden in a Randomly Weighted Neural Network?" https://arxiv.org/abs/1911.13299v2

Seems relevant to what you're working on. It starts with a randomly initialized, overparameterized neural net, but instead of gradient descent backpropagation, it learns by deleting connection edges.

kyllo··on Data wrangling in Elixir with Explorer, the power of Rust, the elegance of R
The data types make sense to statisticians. Ordered factors are great when you need to fit, say, an ordered logit regression model.
kyllo··on Data wrangling in Elixir with Explorer, the power of Rust, the elegance of R
A lot of programmers dislike R for the same reason they dislike PHP: weak typing.

If you can get over that, though, there's a lot to like about R. It's sort of like a hybrid between a Lisp and an array language.

kyllo··on Data wrangling in Elixir with Explorer, the power of Rust, the elegance of R
Elixir runs on the Erlang VM, which is designed for distributed multi-process concurrency, right? Why would this be advantageous for interactive data analysis work, which is typically done on a single node? I don't quite understand the use case, hoping someone can explain.
kyllo··on Maybe treating housing as an investment was a mistake
That is also happening--lots of Hawaiians are being forced to move to the mainland because they can't afford housing in their home state. https://news.yahoo.com/native-hawaiians-flock-las-vegas-1357...
kyllo··on Weakening TLS protection, South Korean style
I lived in Korea in 2008-2010 and can confirm the ActiveX thing was still in widespread use then. It was a pain because every website effectively only worked in IE, meanwhile I had a Mac and couldn't log into any secure websites such as my local bank account from it.
kyllo··on Flexport slashes 20% of global workforce over weak 2023 volume forecast
I think part of the problem with that pitch is that the cost of an IT integration in this industry could pay for a lot of people in Asia to manage a forwarding operation in Excel. Ocean carriers don't have like, APIs. It's all custom integrations with EDI, SOAP, or CSV-over-FTP and you have to have a lot of tedious meetings with them to figure out how to map out and interpret the data they can send and receive.
kyllo··on Flexport slashes 20% of global workforce over weak 2023 volume forecast
Yes, a freight forwarder is sort of like a travel agent for freight--it's a middleperson role, in contrast to carriers, which are "asset-based" and operate vessels/planes/trucks.

Another significant cost factor for a freight forwarder is IT integrations with customers and carriers--many of which are very old-school and use EDI, SOAP, or even CSV-over-FTP to communicate shipment instructions and statuses.

I'm not sure to what extent Flexport implements these kinds of integrations with their partners, but there is definitely a significant hurdle to breaking even on investment in this kind of automation vs. just hiring clerks to process everything manually with e-mails and phone calls, especially in countries with lower labor costs.

kyllo··on Ask HN: GPT-3 reveals my full name – can I do anything?
Chilling effects are not unequivocally bad though. When the speech in question is advocating for stripping away the civil rights of or committing genocidal acts against certain groups of people, I'd much rather that speech be chilled.
kyllo··on One Year with R
data.table also uses OpenMP to parallelize operations, so it tends to be much faster
kyllo··on FastAI.jl: FastAI for Julia
Why not? Honest question--I haven't used fastai myself but my understanding is it's just a high-level wrapper API for PyTorch. Any particular reason why you wouldn't want to use it outside of the course?
kyllo··on Copilot regurgitating Quake code, including sweary comments
Yes, you can. There are algorithms for rounding up, rounding down, rounding to nearest, and banker's rounding, on the results of integer division. This is a solved problem.
kyllo··on Jaguar Land Rover to suspend output due to chip shortage
I'm even seeing stories about U-Haul trucks all being rented out by tourists because rental cars are unavailable, causing a shortage of rental trucks for movers.
kyllo··on Data Science in Julia for Hackers
I think they're referring to the JIT compilation time. There are some ways to mitigate it, such as creating an image using PackageCompiler.jl, but it's definitely a noticeable issue IME. https://julialang.github.io/PackageCompiler.jl/dev/
kyllo··on Show HN: Relocate.me – get your next tech job abroad
Cool idea, I hope it grows. Would like to see more positions in Asian countries, they currently appear very limited.
kyllo··on A Poetic Apology: Or Why Should You Use Poetry to Manage Python Dependencies
I went from Pipenv to Poetry and then back to Pipenv after encountering an infinite loop in Poetry's solver on multiple separate occasions.
kyllo··on Setup Anaconda, Jupyter, and Rust
Yeah I think Rust's place in this ecosystem is a C/C++ replacement. All the Python and R data science packages call into native code to do the heavy lifting--the linear algebra, gradient descent etc. The next Tensorflow or PyTorch type framework could be implemented in Rust instead of C++. But it shouldn't matter to the end users--they would still use the Python or R bindings so they can have an interactive REPL environment to do their analysis in.

Julia is interesting because it's performant enough to implement these things directly--Julia's machine learning frameworks are written in pure Julia (with the exception of the calls to CUDA libraries for GPU) and can achieve near-native performance, so solving the "two language problem" is part of its value proposition. I do wonder how valuable it is for the whole stack to be written in one language, and whether that will blur the lines between the software engineers who implement data science packages and the data scientists who use them.

kyllo··on What I wish someone had told me about tensor computation libraries
"Deep Learning in Clojure with Fewer Parentheses than Keras and Python"

Love it! :D What better way to define a neural network in code than an S-expression?

kyllo··on Fujitsu announces permanent work-from-home plan
People go where the jobs are. They are going to live wherever employers "insist on" locating their offices.

20% down payment isn't a myth; if you don't put 20% down (and don't have some special situation like a VA loan) you have to pay for private mortgage insurance which can be hundreds per month, as you're buying the lender insurance against the possibility of you defaulting on your loan.

kyllo··on What every scientific programmer should know about compiler optimizations?
Are you talking about things like very small differences in the results of floating point calculations?
kyllo··on A simple way to get more value from metrics
You lose a lot of the benefits, but you can still take advantage of time range partition elimination just as long as your data is still physically partitioned by the timestamp column. That's the most important thing when processing time series data--never read from disk any of the data that's outside the time range you actually need for your query.
kyllo··on I/O library 6x faster than fmt, 10x faster than stdio.h and iostream
Is this generally the case across all major C standard library implementations or are some of them much faster than others?
kyllo··on Ask HN: If you could work remote where would you live?
Still around the Seattle Area, but a cabin deep in the Cascade mountains where I could go hiking every day, or snowshoeing in the winter.
kyllo··on SQLite 3.32
SQLite was started by Dwayne Richard Hipp from North Carolina. 20 years ago.
kyllo··on DuckDB: SQLite for Analytics
Yep, compressibility is another big win made possible by columnar layout, and it looks like DuckDB implements at least some form of column compression.
kyllo··on DuckDB: SQLite for Analytics
Yes, it's geared toward reporting / analytics / data science workloads where the most common read operation is calculating aggregate metrics like count/min/mean/max and histograms. Statistics stuff.
kyllo··on Jepsen Disputes MongoDB's Data Consistency Claims
Ah, good to know. I saw it when someone I follow retweeted it yesterday.
kyllo··on Jepsen Disputes MongoDB's Data Consistency Claims
Perhaps, but the point is, if you're working in DevRel and you think your role is to defend the product from criticism, and you do it by placing the onus on the developer to figure out how to use your product safely, you've totally lost the plot.
kyllo··on DuckDB: SQLite for Analytics
DuckDB is developed by the same database research group at CWI that developed MonetDB, so they have applied a lot of the lessons they learned from MonetDB.
← PreviousPage 2 of 34Next →