Or just never install an identity in the default location (.ssh/id_*)