The letter that I read[1] states:
"Recently, Googlers voiced concerns about Maven internally. Diane Greene responded, assuring them that the technology will not “operate or fly drones” and “will not be used to launch weapons.” While this eliminates a narrow set of direct applications, the technology is being built for the military, and once it’s delivered it could easily be used to assist in these tasks."
and:
"Building this technology to assist the US Government in military surveillance – and potentially lethal outcomes – is not acceptable."
So the concern seems to be that the military can easily repurpose Google's technology to lethal ends.
[1] - https://static01.nyt.com/files/2018/technology/googleletter....