The limitations you described are true for a wired approach to last mile internet delivery to every user.

You can get around these problems as a wireless ISP using spectrum in the public domain. Idea is that you beam connectivity to a router in each subscriber's home. You'll need to install nodes that connect a wireless network to fiber optic cables, but these connections are much more accessible than wiring up every building in a city.