Had to login to counter with my experience. I'm on MacOS and there is no delay at all when tabbing to Firefox. It's as instant as tabbing to any other app. Also, I'm not ashamed to say that I have more than a few tabs open.

I thought I was crazy! Would love a fix for this