I think it's cool. I don't care that Foursquare has my location. And I continue to use Swarm because I want a record of where I've been and where I want to go.
After watching Long Shot on Netflix, sometimes I'm sort of glad I (and a few other companies) have a corroborated log of where I've been at specific times.