Here in Berlin we have a service for exactly this called the Wärmebus (warm bus) run by Red Cross and the city. Social workers come out in a van, talk to the person, help them however possible.
If they're willing to go to a shelter, they'll take them there. If not, they'll give them a cup of hot tea/coffee and whatever they need to stay warm: a jacket, sleeping bag, blankets, etc.