HNHacker News
TopNewBestAskShowJobs

wuschel

2,232 karma · joined October 8, 2013

Former scientist/entrepreneur, looking what to do next

hn (at) rtoip (dot) com

submissionscomments
wuschel··on CEO fired developers to make room for AI. Developers create open source AI CEO
The way you have expressed it there are optimized workflows not only the managerial/executive, administrative, content producing set of workers, but in almost every profession, encoded in beaurocracy, checklist, best practices and culture: doctors, care workers, lawyers, policing ...

The question is how well language models have internalized the optimal decision pathway and mitigating strategies to deviating circumstances. What data do they have to be trained on? If an AI defeats the best Go players in the world, surely it is a good question whether they can exceed in games with large unknowns such as business administration.

As mentioned somewhere else in this thread, the moral and ethical layers is where some of the challenges of these system can be found.

wuschel··on CEO fired developers to make room for AI. Developers create open source AI CEO
I have no experience with data on bad and good CEOs depending on their working context.

At this stage, this seems to be a demo, albeit an interesting one. I find the concept still very intriguing, as it is exactly the thing that attacks white collar functions in administrative and executive tasks sets. I need to give it a spin.

wuschel··on Apple Mac Studio M5 Ultra with 1.2TB/S Memory Bandwidth
I know. It hurts. But I have the feeling that you get what you pay for.

The purchase cost of H100 or B200 systems with comparable VRAM is a one order of magnitude higher. Although I can only guess how much lower the token/sec output of the Mac Studio will be. Probably 2-3 magnitudes lower?

While a cluster has to work with many users simultanously, and is a good investment for a company, perhaps the Mac Studio will be a good use case for a personal larger LLM deployment configuration.

Perhaps someone has the token/sec numbers for larger models running on older Mac Studios?

wuschel··on AI is hitting entry-level jobs hardest, Stanford study finds
> the most productive people with AI on my team are the two youngest. They don’t have product wisdom, yes, but the gap is so noticeable

Is it Software or another problem domain? What problem are they attacking, what stack/method are they using?

wuschel··on New Mac mini, featuring M6 and M5 Pro
> AI isn't adding much productivity

Would love to know where this comes from. I am not sure about that. Could you point to data/anecdata?

wuschel··on Anthropic's 'watermark' text adulteration in Claude is a perversion of writing
I had the same thought.

I hope the other providers will add a geographical limitation on this EU rule.

(On a side note, I wish they would replace those EU beauracts with LLms).

wuschel··on Anthropic's ‘watermark’ text adulteration in Claude is a perversion of writing
Where is the problem with using LLM generated text?

You could use your own hypothetical house elf to do it for you, or pay someone to do it. LLMs are just cheaper for a certain set of problems.

People will find ways to circumvent this, so this limitation will only hit the technically less adept people.

wuschel··on Samsung is using Claude to verify chip designs. It's not going smoothly
I was not trying to say that statistical can't generate deterministic code - I was wondering what tools I could use to make sure that they catch all the invariants when given a specification of inputs, logic layouts, and outputs. Certainly, feedback loops have to be involved - e.g. look at the lifetimes guarantees the Rust compiler gives - to make sure the answer is refined in iterative steps.
wuschel··on Samsung is using Claude to verify chip designs. It's not going smoothly
Hey, thank you so much for jumping in and for your elaboration.

> SOC and piece of test equipment might have it's own control language

OK, so apart from code generation the LLMs are providing language integration and data integration.

But how would you control quality, or make sure the LLms does not create some unwordly control code? I am trying to understand if they are using type checking or any other methodology that keeps the LLM generated code in check.

I am not from the hardware field, but I do understand that we are trying to build deterministic mashines. It is quite mindboggling that we are using statistical models for building the test suite, instead of, say, permutating through all critical input states and testing the output parameters for it.

I am asking because this isnt certainly the only mode of operation for LLMs in testing and quality control, and I would love to get a better understanding how to build such a system.

wuschel··on Samsung is using Claude to verify chip designs. It's not going smoothly
I understand that they used Claude to create some sort of verification code and test environments from circuit-design information, verification programs, and protocol specifications. But isn't precisely this quite risky due to the statitical nature of LLMs? I would have thought that they rather operate with very rigid test suites based on such software like F*, Coq, and whatnot.

Can someone with understanding of the process chime in here?

Here is the text snippet from the original korean article. Indeed the information was misrepresented:

"Customer-specific SoC verification work, which Usually takes Over a month, was completed in just two days. A second-year employee completed a USB model development that previously takes a month in a single day".

wuschel··on Deutsche Bank becomes first foreign yuan clearing bank in Europe
How come Deutsche Bank, a German bank, is the first bank doing this? And why now? Is it because the less friendly political stance towards Europe from the US side that the tables have turned a bit?

I also wonder how much political backing a bank needs to offer a service with the implications towards the status of an allied currency as reserve currency status - small as it may be for now.

wuschel··on The lifesaving secret hidden inside a horseshoe crab's blue blood
> Now 80 percent of it is done using the alternative.

Did not follow the industry since 2018, but it is quite a feat switching the supply chains to the recombinant version. Good to hear that they managed to do it. I wonder how other Pharma and Medtech players are doing in that regard.

wuschel··on The lifesaving secret hidden inside a horseshoe crab's blue blood
The horseshoe crab story comes up on HN now and then. Typical media game, the crabs crawled out their appointed time slot in the media publishing calendar.

Here is a full disclaimer (from the trenches of startup land): I co-founded and ran a biotech startup that tried to disintermediate that particular supply chain. We even flew to SF to speak to some of the YC chaps, and talked to a strategic buyer. Our technology R&D failed to deliver, unfortunately. And the market is fairly small. But I learned a great deal re that particular business, and a lot of more general lessons. All in all, a crazy run with so many crazy stories, I need to write them down one day.

Horseshoe crabs are truly fascinating animals in respect to their physique, lineage and behaviour. But these things one can read up on Wikipedia.

We had quite a bunch of them in our lab (and living room). They were supposed to be voracious predators to all things they can eat, but ours developed a rather expensive habit in captivity by only eating the most expensive of goods from the local fish market. They would not eat anything else.

wuschel··on The lifesaving secret hidden inside a horseshoe crab's blue blood
A pin? I did and fought for the cause. Happy to share. See my other post in this thread.
wuschel··on Bioengineered chewing gum may offer a way to fight HPV and other microbes
Sounds interesting, indeed. Just dug up this review [1] that claims there were no adverse effects from any of the interventions, and that after 2.5 to 3 years of use, a fluoride toothpaste containing 10% xylitol may reduce caries by 13% when compared to a fluoride-only toothpaste.

I wonder how well bacteria will adapt long term in your mouth to Xylitol exposure through bubble gum based adminstration.

[1] Xylitol-containing products for preventing dental caries in children and adults. Cochrane Database of Systematic Reviews 2015, Issue 3. Art. No.: CD010743. DOI: 10.1002/14651858.CD010743.pub2.

wuschel··on I’m leaving OpenAI to build telepathy
"Die Gedanken sind frei..." - can someone guess them? A truly dystopian question.

It is been 10 years ago when I looked through some research in that area. Back then it was the problem to get enough good signal. Has the situation changed radically here for non-invasive electrodes or portable detectors?

I understand that the approach would be to turn weak signal, context, and LLM based signal processing into useful human computer interaction. For everything else, I have the feeling we are still in speculative territory.

wuschel··on An SLM trained on $8 ESP32-S3
I love the cool tech demo! I also would have loved to see a offline sensor calibration package - or whatnot - and analysis of model precision instead of Klingon. Just trying to think up of an actual use case where you would actually truly need an LLM instead of one of the other well known data analytics methods.
wuschel··on An SLM trained on $8 ESP32-S3
Aw, that is truly annoying...

Thanks for pointing it out!

Until now I never experienced something like this.

wuschel··on An SLM trained on $8 ESP32-S3
I understand that you are alluring that maximum training-state memory, not parameter count, is the key variable here. So you better start with the smallest model, and go to for highest training data quality, with the outlook of coupling systems together?
wuschel··on Learning-Rust.Github.io: Rust Programming Language Tutorials for Everyone
Books that come into my mind that might be useful to you:

A Philosophy of Software Design — John Ousterhout

Designing Data-Intensive Applications — Martin Kleppmann

Domain-Driven Design — Eric Evans

There might be some courses as well, but I never looked into them.

This also works quite well:

Write down the problem. Think real hard. Write down the solution. (Thank you, Feynman).

wuschel··on Simulating TCP loss and congestion in browser using Go/WASM
Hi!

Many thanks for the link! I want to make a side project involving some sort of simulation, and I certainly have a look at it for inspiration.

Cheers!

wuschel··on More German than many Germans
> Speaking of which, a lot of German natives complain and some are even leaving the country (around 100k left last year), but honestly I have visited / lived in nine countries, and people have no idea how good they have it here.

The grass is always greener on the other side ... until you actually dare to find out. Having lived and worked in many a country, I second your opinion that it is often about trade offs. Problems will come and go. You have to choose the problem you want to work with.

Germany certainly is one of the top countries to live in.

wuschel··on Simulating TCP loss and congestion in browser using Go/WASM
Quite incredible how you can visualize real time simulation by combining Go, WASM and JS. Thank you for posting this.

What would have been great is to compare different graphs next to each other (e.g. bi-colour plots). Also, I wish I could follow the thought process on the choice of tools.

Amazing work!

wuschel··on They Stole Your Attention
Upvoted. IMHO quite shocking numbers if you think what it does with society as a whole. There will be a variation in statistical spread in different countries/cultures, I would love to see them. Where do you have the base data from?

What is more shocking what this does to people that have never been bored or cut off from media. The pure social media generation so to say.

I liked the idea attention measurement clock on the bottom of the page.

wuschel··on I'm 38 and I Can't Support Myself Anymore
Where did you end up? Do you have a way to PM you?
wuschel··on Using an open model feels surprisingly good
Interesting and very curious what you manage to verify and produce with it.

What kind of fields are we talking about here? Compsci? EEng? BioChem?

wuschel··on Modern email can be built from borrowed parts
> Optional postage for strangers: the server can answer a first contact with a 402. Configurable per mailbox; the cost of cold spamming stops being zero.

Interesting take re putting a cost on spam. Perhaps another take would be functionally implementing introductions.

> First-contact consent: an unknown sender doesn't get into the mailbox; they land in a "requests" box with their first message visible (like Signal's message requests). You accept, and the thread opens forever. A stranger can knock on your door, which is the essential property of mail, but they can't fill up your living room.

Unfortunately, this will only move the problem, and only reduce it in the case when all outside communication is ignored.

wuschel··on Engineering management after the cost of code collapsed
My guess would be that this is a matter of fine-tuning the model to the problem. You would need to run the review experiment N times, observe the distribution of answers, and then fine tune with model operational parameters.

Perhaps someone more knowledgable could jump in here to clarify?

wuschel··on Show HN: ReadKinetic – a free, local-first speed reader for your own books
Very nice implemenation re usability. I have seen this before, somewhere, years ago - perhaps even on HN.

Such a solution applies for text only instances. How would you solve it when graphs come into play? Display a graph next to it and pause the text?

wuschel··on Apple sues OpenAI, accuses ex-employees of stealing trade secrets
Side question to you, considering your occupation:

Could you please list a set of core papers (or other resources) that give a beginner an overview or even understand of the fundamental concepts and techniques with LLMs?

Thank you!

← PreviousPage 2 of 21Next →