HNHacker News
TopNewBestAskShowJobs

dfgtyu65r

23 karma · joined October 12, 2022

submissionscomments
dfgtyu65r··on Speech Recognition and TTS in less than 500kb
This is so alien to me. Why not plug into the machine matrix when out in the great outdoors enjoying sublime nature? Why not!
dfgtyu65r··on The model is the product
Given the number of paying subscribers versus total users of ChatGPT, this isn't the case.
dfgtyu65r··on Poland fumes over US block on AI chips
> Let's hope Trump's administration presents a more EU friendly view on this issue.

Is that likely?

dfgtyu65r··on Cerebrum: Simulate and infer synaptic connectivity in large-scale brain networks
I mean HH is an elaboration of the LIF with the addition of several equations for the various ion channels, but yeah I see what you mean.
dfgtyu65r··on Cerebrum: Simulate and infer synaptic connectivity in large-scale brain networks
So, if I understand correctly they're using Hodgkin-Huxley LIF neurons but trained end-to-end in a graph neural network. Through training to reproduce the neural data, the network learns the underlying connectivity of the neural system?

This seems very cool, but I'm surprised this kind of thing attracts VC money! I'm also skeptical how well this would scale due to the inherently underdetermined nature of neural recordings, but I've only skimmed the PDF so may be missing their goals and approach.

dfgtyu65r··on Mira Murati leaves OpenAI
This feels naive, especially given what we now know about Open AI.
dfgtyu65r··on You got a null result. Will anyone publish it?
None of these are negative results in the sense of being a 'null' hypothesis?

In the language of hypothesis testing you have your null and alternative hypotheses.

So for alternative hypothesis that the sun comes up in the morning, the null hypothesis would simply be that the sun does not come up in the morning.

Each of the negative results, reads to me like a separate 'alternative' hypothesis.

dfgtyu65r··on Brain circuit scores identify clinically distinct biotypes in depression/anxiety
I don't think that's entirely fair. There does seem to be something distinct about mental disorders - namely, they are defined by the symptoms.

With physical ailments, symptoms are surface manifestations of an underlying physical cause. For example, fever and fatigue in flu are the result of the influenza virus. Crucially, you can have the physical cause without symptoms (such as in the presymptomatic period), so the two are dissociable. Even where the physical cause is unknown, there's still this symptom-cause distinction.

In the case of mental disorders, they're essentially defined by the symptoms. To have depression is to be depressed. To have anxiety is to be anxious. What would it even mean to have depression without being depressed?

While on some level these are physical in a sense (insofar as they result from brain activity), I don't necessarily think we should think about their cause in the same way as a physical ailment.

More to the point, there's a much more obvious sociocultral element to mental disorders. There's no 'objective' line between being sad and being depressed so while we clearly can and should treat depression, it seems to be very different from other diseases.

None of this is to take away from the real suffering people undergo with these disorders. I just don't think that treating them through a strict biological-pathological lens is as useful as people think it is.

dfgtyu65r··on Context caching guide
Sure, but a direct forwards pass of the book would surely require more compute than simply loading and setting the hidden state?

The second doesn't require any matrix operations, it's just setting some values.

dfgtyu65r··on OpenAI – transformer debugger release
Normally, the LLM is composed of multiple transformer blocks, where each block consists of the (mutli-head) attention and fully-connected feedforward components. These are then stacked on top of each other to give the final output of the network.
dfgtyu65r··on A Sun-like star orbiting a black hole
If you're interested in reading something similar, your description reminds me of The Black Cloud by the astrophysicist Fred Hoyle. I have to say I found the writing quite clumsy, but owing to him being an astrophysicist himself there was quite a lot of attention to detail in making the plot scientifically realistic (within certain bounds).

https://en.wikipedia.org/wiki/The_Black_Cloud

dfgtyu65r··on Wikipedia is not short on cash
I have to say I can't think of a worse outcome than Wikipedia becoming advertising- or subscription-funded.

At best, it will be less useable and more liable to influence once its source of funding is at the behest of advertisers. And with a subscription model, presumably it would then be pay-to-play which is antithetical to the idea of Wikipedia in the first place.

I also don't agree that Wikipedia has to a significant degree departed from "impartiality, openness and academic freedom", or at least I'd need some sources/examples.