I hate all of those too, which is why a good podcast app is a must. I use Overcast and its ability to quickly skip forward and speed up is awesome.
Marco Arment really does a great job with designing the player from the perspective of someone who consumes a ton of podcasts.