This isn't about trusting you, it's about trusting that your domain belongs to the IP address it's supposed to.
Were the certificate to contain an IP address (or IP addresses), it would need to be updated every time the site started or stopped using a public-facing IP address.