Right, seems like a better way to describe this is to say "Watching sports activates the same neural pathways as playing sports".
There's quite a few things about our brains that might seem obvious, but are actually quite counter-intuitive in practice.