But you yourself don't know the code on the hardware token, nor do you yourself know the information gathering, encoding or decoding for biometric information. Those are still pieces of information, but they aren't "something you know."
To your later point, some later versions of these original authentication factors have added "somewhere you are" to the list.