The software indeed has to do what I do, which is understanding my environment and mentating solutions that are somehow appropriate for either fixing or alleviating any one of the uncountable challenges said environment faces. I cannot even describe what I am doing, only that relatively small parts of the end-result are encoded into symbols called code.
This reminds me of what Bohr said to Oppenheimer - in the movie - when some doubt arose around his mathematical ability: "Algebra is like sheet music. The important thing isn't 'can you read music', it's 'can you hear it'. Can you hear the music, Robert?"
I'm very much wondering if GPT can hear the music, but time will tell if and to what degree this even matters.