An empty Starship has a very low ballistic coefficient, it will be torn apart by the atmosphere if not carefully controlled. Add to that the FTS and there is no real danger to population on the ground.
It's made of 4mm thick steel sheets, and the FAA disagrees with you.