Why would this be unexpected? You can buy apps on Play. You can also cancel your purchase 5 minutes later. In that case it stands to reason that Google would want to have a way to remove the app from your device.