I'm not entirely sure why today's satellite internet connections have such high latencies, but it doesn't seem physically impossible to develop low-latency satellite Internet access.
Edit: It appears nearly all of the current Internet access-providing satellites are in geostationary orbit, which is much further away than a few hundred kilometers, causing a great amount of latency. If Musk can successfully find a way to use satellites in low Earth orbit to provide Internet access instead, that will get rid of most of the latency.