My take is this - to maintain height he would have to switch sides on the upswing. If he's attached to the side of a building he would hit that building first before achieving any upswing.
(Unless of course the web is pulling him in. Possibly it contracts after it hits the buildings, or it reels in somedow)