We hit comment cooldown but it's not foolery exactly, more like reflecting the futility of trying to make these kinds of arguments. The problem with this whole chain is we haven't actually defined what a neuron is. Take the purported bound above. Suppose I move an associated potassium ion farther away. Have I not changed the state? If yes, what's the limit to how far away I can move that ion and have it still count as part of the neuron? That's just one of the limits of physical laws, you can make very precise statements, but only under very narrow constraints.
No, I’m saying having a finite number of neurons doesn’t imply a particular number of brain states. Scaling laws actually don’t apply very strictly to brain size. For example, whales have very large brains but aren’t generally thought to be more capable of reasoning than humans. Women generally have smaller brains than men but aren’t thought to be less capable of reasoning.
Mm not sure that bound applies because neurons are neither of fixed size nor fixed energy. But on the other hand one starts to stretch the definition of neuron.
That implies a lookup table requires me to provide a citation :) In fact, assuming space is not discrete, not only can a neuron be in any of infinite states, per quantum mechanics it can be in multiple at the same time.
Any artificial neural net has a finite set of inputs and a finite set of outputs. That makes it equivalent to some lookup table. You must therefore claim a lookup table has the ability to reason.
I don't think it really matters. Tidyverse is fine for datasets of size 2 * (1...20?) . Data table buys you maybe 21..23? Then you're off to spark for 24+ anyway. So you'd only be covering a pretty narrow slice of the space.
I think this is an incredibly farfetched position. Google has more hardware, several orders of magnitude more data, highly-developed experimentation capability, and at least equivalent ML expertise compared to anyone. If something chat-GPT-like ever actually starts to take off as a product, Google will clone it and crush it.
Could be. It would be nice if you could maintain the modification though because then you don't have to worry about some cancerous cells surviving the first wave.