In the early 2000's, when I was quite involved in UK Skydiving - there was quite a strong bid to try and get it recognised as an Olympic sport. However, the bid was denied and my understanding to the reasoning being that it wasn't a good spectator sport.
However, I believe indoor skydiving is making good progress with their latest bid.