HNHacker News
TopNewBestAskShowJobs

mk67

65 karma · joined January 20, 2023

submissionscomments
mk67··on Trumpcard (Official US Government Website)
It lacked Trump's face and branding.
mk67··on Rost – Rust Programming in German
Working at SAP and working language is English, also in Germany.
mk67··on Show HN: Trolling SMS spammers with Ollama
It definitely will be if you go to court. As soon as you have any witnesses there is little chance to get out of a verbal contract.
mk67··on Show HN: Trolling SMS spammers with Ollama
No, in basically all countries even verbal contracts are valid and enforceable.
mk67··on Tesla Sales Are Tanking in Europe
Very nonsensical statement, as it helps a lot since decades and allows faster traffic flow in roundabouts.
mk67··on Former Google CEO Eric Schmidt's Leaked Stanford Talk
Same when I interviewed ~1-2 years ago.
mk67··on PcTattletale leaks victims' screen recordings to entire Internet
From what I read it's not prosecuted in San Francisco e.g. anymore.
mk67··on Big data is dead (2023)
https://en.wikipedia.org/wiki/Principal_component_analysis
mk67··on GPUs Go Brrr
Not easy to give a concise answer here, but let me try:

The problem mainly occurs in networks with recurrent connections or very deep architectures. In recurrent architectures this was solved via LSTMs with the signal gates. In very deep networks, e.g. ResNet, this was solved via residual connections, i.e. skip connections over layers. There were also other advances, such as replacing sigmoid activations with the simpler ReLU.

Transformers, which are the main architecture of modern LLMs, are highly parallel without any recurrence, i.e. at any layer you still have access to all the input tokens, whereas in an RNN you process one token at a time. To solve the potential problem due to "deepness" they also utilize skip connections.

mk67··on GPUs Go Brrr
I'm in the industry and nobody does that since over ten years. There was just a small phase when Hinton published "Greedy layer-wise training of deep networks" in 2007 and people did it for a few years at most. But already with the rise of LSTMs in the 2010s this wasn't done anymore and now with transformers also not. Would you care to share how you reached your conclusion as it matches 0 of my experience over the last 15 years and we also train large-scale LLMs in our company. There's just not much point to it when gradients don't vanish.
mk67··on New capacitor with 19-times energy density
I thought sunlight and water also kills them.
mk67··on Tesla driver arrested for homicide after running over motorcyclist on Autopilot
There is no LLM in Tesla cars. Otherwise correct. I'd rather expect they use a convnet or a vision transformer, probably the former.
mk67··on How does Shazam work? (2022)
Adding noise is generally helpful for regularization in ML. Most modern deep learning approaches do this in one way or the other - mostly dropout. It improves generalization capabilities of the model.
mk67··on A new quantum algorithm for classical mechanics with an exponential speedup
In that case the speedup would be linear.
mk67··on Taking low-dose aspirin is associated with 20% reduction in cancer deaths
Sounds like bs if you look at Russian numbers.
mk67··on I worked in Amazon HR and was disgusted at what I was seeing with PIP plans
When I interviewed at IBM in Germany in the late 00s I was rejected and got crystal clear feedback on why - and that is a big American company in Germany.
mk67··on Developer account removed by Apple
How would you get the money you possess and want to launder on the stolen credit card? That more sounds like a method to extract money from stolen credit cards, but not a valid way to launder money.
mk67··on OpenAI researchers warned board of AI breakthrough ahead of CEO ouster
Functions are by definition not random. Randomness would break: "In mathematics, a function from a set X to a set Y assigns to each element of X exactly one element of Y"
mk67··on I deeply regret my participation in the board's actions
Come on, it's pretty delusional to think large scale transformer LMs alone could ever reach AGI.
mk67··on Iceland declares state of emergency over volcanic eruption threat
In my experience the Icelandic vikings are quite a bit bigger on average. ;)
mk67··on Gnome Receives €1M from German Government
The truth is that quite some jobs pay >=100k in Germany. Usually needs to be one level above senior engineer, so staff eng. or some kind of manager.
mk67··on Hard-to-swallow truths they won't tell you about software engineer job
Don't think it's necessarily wrong though. I can't think of many professions where a large amount of professionals are pretty bad at their jobs.
mk67··on Falcon 180B
It's not possible to count letters for an LLM; it only "sees" tokens.
mk67··on AOL pretends to be the internet
Yep, playing too much Quake online I hit a record 500 EUR phone bill once (1000 deutsche Mark back then). My parents weren't amused. :D
mk67··on Do we think about vector storage wrong?
Nobody used TF-IDF for vector lookups without applying a PCA first though.
mk67··on Get a cable modem, go to jail (1999)
Literally quite a lot of people have guns in Europe though, many many millions: https://en.wikipedia.org/wiki/Estimated_number_of_civilian_g...

Nevertheless never heard of such a thing happening.

mk67··on Mister Rogers had a point – routinely greeting six neighbors maximizes wellbeing
I must say I never had this train of thought. Whether I'm unhappy or happy I greet my neighbor as it is just common courtesy.
mk67··on Mister Rogers had a point – routinely greeting six neighbors maximizes wellbeing
You die anyway at some point. Not sure what this obsession about maximizing lifetime is about. I rather live like I prefer to and when I die I won't care anymore anyway.
mk67··on The new science of meditation
Very easy for me, never managed to see or imagine anything when I closed my eyes. It's always black no matter how hard I try.
mk67··on I Can Eat Glass
Seems pretty hard without teleportation as your mouth is closed when doing this mostly.
Page 1 of 2Next →