Echo only transmits the audio command to Amazon after you invoke the wake word "Alexa." It's "always-listening" but not "always-recording/transmitting." You can easily verify this by looking at your network activity.
Right?
Not that this is completely secure, of course, but it does suggest it'd be non-trivial, at least.