Because, unfortunately, not everyone has working IPv6 transit. There are still a nontrivial number of ISPs (especially smaller ones) which don't provide IPv6, and residential network hardware like wireless routers which don't support it.
I guess this is currently then the biggest issue with IPv6 adoption: ISPs are not yet ready for it.
Can't talk it to the server if the ISP between you and the server refuses to talk it.