You nailed it. People frequently point out the unattended delivery aspect or talk about shooting drones from the air to get "free" packages.
At the end of the day it's a lot easier for theieves to just follow the UPS truck.
I am still waiting for Prime Now in Vancouver!