HNHacker News
TopNewBestAskShowJobs

layla5alive

474 karma · joined September 1, 2020

submissionscomments
layla5alive··on Ending respiratory infections
Every day that passes this seems to become more true. I don't believe this must be true. I don't believe it was always true.. but gosh have we taken some turns..
layla5alive··on Ending respiratory infections
It is trickling down, always has been! The emperor IS wearing beautiful clothes, also!
layla5alive··on Copper transport drug restores memory and clears toxic Alzheimer's proteins
A lot of people here in the comments saying 'this can't work because amyloid beta hypothesis was wrong' seem to be missing that this treatment is aimed at some of the primary mediators of general brain health (function of natural BBB/vascular waste clearance mechanisms, which seem to degenerate over time, and modulation of neuroinflammation), not just clearing AB proteins pharmacologically. This jibes well with the stated improvements in Parkinsons and ALS.

I doubt there is one root cause of Alzheimers (except maybe in some genetic cases), and this is likely not a panacea, but sounds like it may assist some of the key processes involved in breakdown.

Root behaviors related to sleep quality and quantity, diet, exercise, infection, environmental exposure and stress, as well as genetics, likely all contribute.

But, waste clearing and neuro-inflammation seem to be core processes involved in the progression of the pathology, and improving natural vascular waste clearance seems like a logical place to find at least a small improvement in progression and symptoms...

Analogy: if someone puts metal shavings in an engine, having a better oil filter won't prevent all damage caused by the person putting the metal shavings there (nor will it halt the process), but it will reduce the damage by getting those shavings out of circulation before they have a chance to make even more repeated passes through the engine and do even more more damage. Improved vascular waste clearance is likely only a small piece of the puzzle, like having good oil pressure and filtration, but that doesn't mean it's irrelevant just because it doesn't prevent the other upstream root causes!

layla5alive··on Statement on US government directive to suspend access to Fable 5 and Mythos 5
Indeed. When are we going to wake up and stand up to this? "Freedom?" This is not freedom. Liberty? Nope. This really is techno-serfdom. Power and capability for me (govts / large corps) but not for thee (us, the serfs).
layla5alive··on How LLMs work
Comparing either the Wright Brothers first successful flight (1903) or even an F22 Raptor (released in 2005) to a Sparrow:

"If this is flight, it's really boring. We can't even build a mechanical sparrow that can lay eggs and catch flies. You're telling me we can't run sparrow.exe but we've created flight?"

We didn't build something that flies by flapping its wings until 2010. We'd been building functional airplanes for more than 100 years before we were able to build something that worked in a (more primitive, but) similar way to how a sparrow flies.

I'm sorry that modern machine intelligence is so boring to you.

It isn't boring to me, I'm fascinated both by the ways I'm still far more capable than trillion parameter LLMs, and also by the ways they are already far more capable than I am.

FWIW, while I am not bored by nascent machine intelligence, I am bored by predictable human reactions to it: greed, exploitation, hubris, etc.

layla5alive··on How LLMs work
You evaded any understanding of my point — mistaking the API for the implementation is like seeing a manuscript beside a typewriter and concluding the typewriter wrote it. You wouldn’t do that; why make the same category error here?
layla5alive··on How LLMs work
I think most of the nuance in your first argument was undermined and overshadowed by your fairly categorical assertion that LLMs are bullshit generators and not actually useful.

When you got a reply illustrating how incorrect that claim from your first argument was, you shifted to focusing on the other argument (the one I actually happen to agree with - the cost to society of hitching increasing dependency on big tech will make the social media harms look like childs play).

I think your argument will be better received if you focus on the very valid concerns of societal harms, and acknowledge the ways LLMs are tremendously capable, without downplaying that.

I'm with the person you replied to in seeing how capable LLMs can be when you spar with them appropriately. They confabulate, but that's your job to catch as a sparring partner. But they do bring useful knowledge of thousands of PhDs into conversations - and even if you're among the most erudite humans on the planet, this is still an asset in intellectual search for truth on many topics.

Back to the genuine problems, and they are many: this power, concentrated in the hands of big tech, is a multiplier on the power already concentrated there, with many new capabilities - especially scary being the capabilities for subtly influencing and manipulating both individual and group behavior - for profit or otherwise - by the companies or their customers, or governments, or... The possibility space of harm and abuse is large..

On net, I think we should all be pushing to educate everyone around us on the pros, the nuances, the risks, and the big cons, and working to try to build a future of offline models rather than subscription service dependency..

layla5alive··on How LLMs work
It's a literal truth that predicting the next token one at a time does not preclude intelligence on the other side of the decode function. Deal with it.
layla5alive··on How LLMs work
decode() looks simple! Wow, obviously intelligence can't live behind that function call! /s

Now, take that for loop, and replace the implementation of decode(context, ++position) and pass it to a human who was bored enough to play along and use a notebook to organize their thoughts and translate them to/from this encoding (you might write a helper function to do this for the human in the front-end of the new decode() impl, but the data flow in and out of decode() will remain the same):

decode(context, position)

{

  cached string_answer = ask_human_question_via_context(context);

  return decode_human_answer_to_tokens(cached string_answer, position);
}

Is the output you get not thinking anymore because it passed through this harness? Did the human's mind somehow get reduced to mere interpolation?

The human mind is still a human mind. Putting a simple harness in front of a mind does not affect its fundamental properties.

In an LLM, decode() is calling into a trillion parameter connectome.

layla5alive··on How LLMs work
You're talking about simple compression and encoding mechanisms and by implication you're drawing an analogy to an LLM encoding/compressing the information..

And sure, it does, but the person you're replying to was trying to understand why it also seems to reason about the query to give an answer consistent with it, despite not being trained on that query or answer. Your answer seems to imply that its just another slick complex encoding.

But the emergent property of trillions of digital neurons predicting the next token is that in the process of being trained to do so, they can also learn to reason.

At some scale, it is efficient to encode cognition which is capable of mimicing the cognition which generated the input tokens.

layla5alive··on How LLMs work
So much this - so many people seem to miss the forest from the trees that emergent properties are not bound to the complexity of the underlying mechanics.

All of life arises (maybe) from very simple subatomic particles, and at each stage you can repeat this refrain, complexity increasing as you stack.

layla5alive··on How LLMs work
I could answer the same query the same way as a child.
layla5alive··on How LLMs work
I do not think you are correct.
layla5alive··on How LLMs work
You can also teach humans science and math and then they can be trained by a cult to not use any of that reasoning when emitting canned responses that they were rewarded by the cult for internalizing during their training. "Fake News!"

You're caught up on the mechanics of token processing (floating point matrix ALU math) and ignoring the context that p(next token) as a function being "computed" is doing so over a trillion parameters. You can poorly train a model, sure, but assuming you don't indoctrinate it too much, properties like cognition emerge - it learns to reason; why? Reasoning is more efficient and compact than memorizing answers.

layla5alive··on How LLMs work
Lol, the bird did not 'fly' - it just flapped its wings and generated lift!
layla5alive··on Snowboard Kids 2 is 100% Decompiled
This can't be overstated! Libraries would never be allowed to come into existence today. I think we should all think long and hard about the society we have collectively created. It is not too late to make an effort to fight to reclaim the rights and norms we've ceded...
layla5alive··on To have a moral stance on AI is to be an outcast, and it sucks
"Our society only works thanks to most people being slaves to these tremors."

If everyone defects, the system breaks down. Morality is good and it is actually logical - it solves the prisoners dilemma and pushes cooperation instead of defection. It also reduces harm and has lots of other good properties. I feel that how we affect others matters, but even if you're just a sociopath doing the math, defecting is a strategy that burns things down at scale, not a smart one. Tit for tat with forgiveness is not only morally aligned, but also more prosperous in scenarios that aren't just one-off interactions with strangers.

layla5alive··on There's Never Been a Better Time to Study Computer Science
Heh, I think you meant to say math. Plenty of theoretical CS is study of things like algorithms, which looks more like math proofs than code. But we can all agree that vibe coding has little to do with Computer Science. And if you're not touching or reviewing the code, little to do with anything resembling software engineering, either!
layla5alive··on Was my $48K GPU server worth it?
Salaries are opex
layla5alive··on I'm going back to writing code by hand
This is what I'm seeing - for people who were slow and didn't posses a lot of depth or breadth, their blast radius and impact has skyrocketed. They can now work in unfamiliar domains quickly, without any knowledge of the nitty gritty details of those domains!

For me personally, it's a tradeoff of generating the first pass code 10x more quickly, but then deeply knowing and validating the code is then 10-20x more work than it would have been if I'd written it myself (and if time is of the essence, then there's the option of shallow validation/understanding in exchange for speed - which is a compromise in rigor and path towards tech debt). In the end, none of this seems like a net win (unless you don't care about quality), and it is much less enjoyable.

TL;DR; While LLMs are faster to spit out first pass code, by the time I've validated and fixed the LLM's first-pass work, I could've had my "by-hand" implementation done correctly, and had much deeper understanding out of the box. Net loss.

layla5alive··on Software engineering may no longer be a lifetime career
"Poorer?" That implies they still rely on money. But money is just a form of fiat power. The billionaires/trillionaires will not much need fiat currency or fiat power, because they're building real power.. by extension, they won't really need to worry very much about the rest of us, either..
layla5alive··on VS Code inserting 'Co-Authored-by Copilot' into commits regardless of usage
Funny, didn't iOS have that like 15 years ago, before they probably removed it?
layla5alive··on US special forces soldier arrested after allegedly winning $400k on Maduro raid
I had the same interpretation - Maduro was a bad guy, but when the approach taken is akin to the "Wild West," its hard to claim moral superiority - it devolves to different factions of goons with guns stealing from each other and murdering with impunity, "might makes right."

This stands in contrast to the ideals of a society based on laws and rules, where corruption is a notable exception.

We stand on the precipice of abandoning what the world worked so hard for decades to build...

layla5alive··on DeepSeek v4
Try watching the videos instead of Fox News or OANN.

Pretti tried to help a woman who was pushed down by masked agents, they then attacked and executed him.

Good tried to turn AWAY from the man with the gun and get out of the situation and he stepped in front of her and executed her, shooting even after she'd driven past him without hitting him despite him putting himself into harms way.

layla5alive··on US national level OS-level age verification bill proposed
This is such a bad decision - its infuriating. Incredible overreach of state power. This decision laughs at values such as liberty and freedom.
layla5alive··on AI overly affirms users asking for personal advice
This has also been my experience - asking it to take the devil's advocate of the other side of the coin and assume the persona of 'X relevant highly rational type with deep knowledge in the field' both have a lot of utility. You can do this in more than one dimension, too.
layla5alive··on AI overly affirms users asking for personal advice
Exactly all of this - I didn't have my popcorn out, I was genuinely curious about the nature of the risk being discussed. I find the post basically worthless without context - a wood stove is dangerous if you place your hand on top of it while its hot, but not in the same way a grenade is dangerous if you accidentally remove the pin without understanding the consequences..
layla5alive··on AI overly affirms users asking for personal advice
Its not that LLMs are stochastic parrots and humans are not. Its that many humans often sail through conversations stochastic parroting because they're mentally tired and "phoning it in" - so there are times when talking to the LLM, which has a higher level of knowledge, feels more fruitful on a topic than talking to a human who doesn't have the bandwidth to give you their full attention, and also lack the depth and breadth of knowledge. I can go deep on many topics with LLMs that most humans can't or won't keep up on. In the end, I'm really only talking to myself most of the time in either case, but the LLM is a more capable echo, and it doesn't tire of talking about any topic - it can dive deep into complex details, and catching its hallucinations is an exercise in itself.
layla5alive··on AI overly affirms users asking for personal advice
Many other humans are .... Not very available - certainly many shut down when conversations reach a certain level of depth or require great focus or introspection..
layla5alive··on AI overly affirms users asking for personal advice
Any more context you're willing to share?
← PreviousPage 4 of 10Next →