Felt like a complete idiot, I guess I'm not smart enough to use AWS's UI in a safe way. When we start trusting tools, we inevitably become complacent. Some user flows are designed to be gotcha's. A little gotcha machine that generates |cost - refund| revenue. They gotcha, and there's nothing you can do about it but beg them for a (usually partial) refund. The refund is the thing that makes you feel better about it.

¯\_(ツ)_/¯