I don't see the point in verifying that I'm connecting to Let's Encrypt. If I am not connecting to Let's Encrypt then the cert I get back won't show as being issued by them.
An authentic connection to LE is literally fundamental.
Unless you validate the certificate that you get using a pre-installed LE root certificate.