It's funny, yes, you could expect that, but in reality TF is almost never faster than Pytorch
Just kidding, but yeah - my understanding is that Tensorflow V1 was annoying to use and that Tensorflow V2 sort of "pytorch-ified" everything but it was a.) breaking changes and b.) too little too late.
Now Google has JAX (they JIT numpy so it will run well on their TPU's + autograd) which is coming along nicely and takes a different approach from pytorch. I'll still be using pytorch or a wrapper for pytorch-isms however.
"PyTorch is the Pythonic way to learn machine learning, making it easier to learn and simpler to code with. This book explains the essential parts of PyTorch and how to create models using popular libraries, such as PyTorch Lightning and PyTorch Geometric."