LLMs are deterministic though? like with 0 temprature you always get the same output (temprature is literally injected randomness because by default they are "too" deterministic)
A 0 temp LLM is just an autocomplete. Not even spicy.
LLM implementation may be deterministic or not. The idea/tech itself does not restrict this in any way.
You can coerce deterministic and reproducible outputs from an LLM
What do you think LLMs are made of?
poor question, we know what human brains are made of, doesn't help us understand them all too much.