armatav

It’s literally usury.

That's super interesting, I wonder if dropout applied in a certain pattern of segregation could induce more neuron dependence, instead of less. Or do some anti-dropout where a dedicated portion of the model is used. Not sure why you'd want that, but it might be interesting to explore.

Is that necessarily the case for massive LLMs, or could there be a more refined grouping?

And you could identify these neurons using dropout techniques and repetitively querying the model against them.

Drop a set of neurons and there’s no change? Probably doesn’t contain the “sky color” concept.

Drop a set of neurons and the model freaks out, definitely conceptual neurons.

Rinse and repeat to find the distilled pattern across all the neurons.

You could train an LLM against the neuron graph to do this for you.

In fact I bet you could update like one or two neurons for certain concepts, and then transplant those neurons to another LLM to give it some idea of it. Like a literal brain transplant but for concepts.

I wonder if you could perform inference, highlight the weights that were most used during that inference, grab the hottest 20%, freeze the rest of the model, and perform backpropagation solely on those to allow for more of this sort of rapid memorization behavior closer to the end user.

Like online learning in a way. But you do it during inference time.

There’s no way the entire model actually needs to be touched for something like “sky color is:” and “blue”.

Because it’s way easier to tangle stuff than untangle it - typically it just gets bad enough and someone goes “okay rewrite”

That’s quite young, what a shame - Vim is amazing.

During the times in which they are illegal, there's a certain beauty to the rebellion of a person fed up enough with their unconscious misalignment that they break the rules and heal themselves. (as long as they don't get punished for it. if they're punished for it, the society becomes a degree crueler)

Of course, it would be a lot better if they were legal, but I don't particularly want to see a time in which the only way you can get access to these things is through system-mandated control.

Actually, there's some literature on it being used to cure schizophrenia, autism, depression, mania, etc.

If you abuse it, or mix it with something else, you can hurt yourself for sure.

LSD used correctly is an insanely effective way to combat addiction

excellent

Are these models aligned?

Of course it will - it will make everyone equally as useless at the subject

I mean plant based meat replacement meals, the fuck?

This is true - everything along the lines of plant based food has an underlying capital cost transformation driving it, not a cultural or environmental basis.

That’s why they need to convince/mandate people to eat it; it tastes worse and is worse for you.

“Venture scale” scales with the percentage VC makes up of its LPs portfolios, and scales with the amount of money in circulation.

Maybe you get rogue waves in it too

I hate to break it to you, but the poverty line in the Bay Area is not my definition.

$110k is the poverty line here. You cannot live here if you’re middle class.

End of story.

Read.

“I suppose, that’s probably what you need to have a middle-class lifestyle up there too”

The point I’m making is that the median middle class income, $70k/year, doesn’t work - which is in agreement with him - pay attention.

It makes it higher than the median wage he mentioned…

$6k+ per month in Mountain View minimum to not live in a shack.

It’s up to the individual. If they want to limit test their HPTA, they can do that.

Holy awful

Hm, still don’t see the 32k context in the Playground

I wonder how they train that image filter at the bottom

thinking emoji

The statement was about skin cancer, and the implication is that they did nothing about it.

Sunscreen is a 20th century term, and modern sunscreen as we know it came into use in the mid-20th century.

Point being that ancients did not use sunscreen or anything remotely close to the formulae we have today - what we have today was roughly defined 100 years ago and has some serious consequential effects on the endocrine system and more.

Also not seeing titanium, zinc, oxybenzone, octinoxate, octisalate, or avobenzone.