Sure, it could be used to perpetrate a Holocaust or something, but so could the 101st airborne.
If the government wanted to go all Hitler on us, they already can get google data, facebook data, medical records, essentially everything that is kept on you. Hell, I bet google location services tracks me better than a drone does (if the war in the Pakistan tribal areas is an example).
And drones are way easier to shoot down than googles datacenters.