It's not impossible:

http://www.technologyreview.com/view/517336/physicists-detec...

Lasers have been used for 50+ years in the intelligence community to eavesdrop on voice conversations.

https://en.wikipedia.org/wiki/Laser_microphone