If you watch the first stage telemetry as it comes back down on the livestream (they don't always show you it, sadly) you can see that actually a huge proportion of the velocity is lost through atmospheric drag. I was shocked the first time I saw it.
Obviously the terminal velocity of the stage is still pretty fast but compared to the speed it starts at it's much smaller.