> but also who is to say that somewhere in those billions of parameters there isn't something like a model of goals and emotional state?
No one, but as is well established, absence of proof of nonexistence isn't an argument for existence. https://en.wikipedia.org/wiki/Russell's_teapot