I was in the same position as you (upgraded iOS several times on a 4S) and experienced the same issues, but I found a clean install dramatically improved performance, though not to the same snappiness of iOS 6.

I love the feel of the hardware, but for >95% of the phone's life it's been wrapped in a waterproof case, so I don't really benefit from it much.