HNHacker News
TopNewBestAskShowJobs

w1nk

181 karma · joined September 14, 2010

submissionscomments
w1nk··on Why is AI so useless for business?
Your post makes some really salient points, and then misses the head of the nail in my experience. Sure, most of the information Sears historically collected is probably junk for supervised learning models. That isn't what makes this hard. High cardinality categorical features aren't what makes this hard. Re-engineering the business processes aren't what makes this hard.

What makes this hard, is that for all of these companies, machine learning models are essentially used in place of heuristics of varying degrees of complexity. The models are being used to incrementally improve heuristics that in some cases are tuned quite well. Couple that with the issue that a machine learning model is only one piece of an actual product improvement for these websites/companies (ie: now you have a prediction, what are you gonna do with it to effect the product?), and all of the sudden you have actual incremental improvements completely misaligned with moonshot expectations.

We've had plenty of rankers and recommenders for decades, the current wave of deep learning variants are improvements, but they're incremental from a high level. If your business wasn't successful/is failing using simple heuristics (sears, jcp, etc), a machine learning model isn't going to magically correct that.

w1nk··on IBM sues Airbnb for patent royalties
I don't believe the claim of their publishing rate is accurate. They published over 300 papers last year according to the research website (https://research.fb.com/publications/?dateYear=2019).

Is a small university department really producing more than a paper per working day?

w1nk··on Does my data fit in RAM?
Another poster already replied with a decent refutation of this claim, but a single pass over a TB of data is often not enough for 'big data' use cases and at tens of minutes per pass, it may very well be infeasible to operate on such at dataset with only 64GB of memory.

In the machine learning world, some of the algorithms that are industrial workhorses will require you to have your dataset in memory (ie: all the common GBM libraries), and will walk over it lots of times.

You may be able to perform some gymnastics and allow the OS to swap your terabyte+ dataset around inside your 64GB of RAM, but the algorithms are now going to take forever to complete as you thrash your swap constantly while the training algorithm is running.

tl;dr - a terabyte dataset in the machine learning context may very well need that much RAM plus some overhead in terms of memory available to be able to train a model on the dataset.

w1nk··on GPUs as a service with Kubernetes Engine are now generally available
Hm, actually sorry I assumed they had made vizier available as a blackbox service (https://static.googleusercontent.com/media/research.google.c...). If they haven't, you can save money/time by employing better than grid search. There are some re implementations of vizier available, I'll see if I can make ours too (email in profile). I do agree with that billing can be..complex ;)
w1nk··on GPUs as a service with Kubernetes Engine are now generally available
Out of curiosity, why are you grid searching if you have access to google's infrastructure (vizier, etc).
w1nk··on Lavabit's Dark Mail Initiative
Viewed slightly differently, given that news is mostly soundbites, which is going to be more memorable?
w1nk··on Here comes the greatest Internet landgrab in history
Slightly off topic, but even with access to the RFC you weren't likely to get that one right. Validating any email address correctly with a regex is nearly impossible (a canonical example of the horror: http://ex-parrot.com/~pdw/Mail-RFC822-Address.html and even that one has a limitation or 2). I think the only correct answer to that question is to suggest an alternative to a regular expression. It could be that was the answer they were looking for.
w1nk··on Let's make TCP faster
It doesn't have to be slow. It can be (especially in larger networks) due to spanning tree on the switches. Check out: http://serverfault.com/questions/102346/dhcp-server-slow-to-...
w1nk··on Those 500K Bitcoins that caused the flash crash weren't real
Where did you see they used floats? I missed it.
w1nk··on OS X – Safe, yet horribly insecure
You should also check the clocks on all the machines involved. Kerberos is quite finicky when the time between machines starts drifting.
w1nk··on Steve Jobs on Xserve: Hardly Anyone Was Buying Them
More than just VT tried it.

http://www.apple.com/science/profiles/colsa/

w1nk··on 12 Months with MongoDB
Sure, check out:

http://www.mongodb.org/display/DOCS/Dot+Notation+%28Reaching...

w1nk··on 12 Months with MongoDB
Have you actually looked at or used the array stuff in postgres? It's pretty horrible syntactically and worse, very explicit in it's recommended use.

"Tip: Arrays are not sets; searching for specific array elements can be a sign of database misdesign. Consider using a separate table with a row for each item that would be an array element. This will be easier to search, and is likely to scale better for a large number of elements."

Searching an array is a pretty common task, Mongo does really well in its ability to search into objects in a document.

I had to laugh a little at one of the sample queries:

SELECT f1[1][-2][3] AS e1, f1[1][-1][5] AS e2 FROM (SELECT '[1:1][-2:-1][3:5]={{{1,2,3},{4,5,6}}}'::int[] AS f1) AS ss;

Seriously?

w1nk··on The difficulties of providing 110-volt power to your airline seat
It won't. The solution is to force everyone to use the 'car' (or cigarette lighter) variant of their chargers.
← PreviousPage 3 of 3