Yes, but note that this is true of all Certificate Authorities. There is nothing special about ACME here.
> it seems like you could just put a TLS public key directly in a domain record, and have browsers read that
Ignoring DoT/DoH, DNS records are sent in plaintext with no integrity checks - anyone on your network path can replace the public key response with one of their choosing, allowing them to MITM your connection. DNSSEC provides integrity of DNS responses, and if it were more widely adopted then people could set their certificates as DNS records - this is precisely what DANE [1] is. But, DNSSEC will never see wide adoption.
[1]: https://en.wikipedia.org/wiki/DNS-based_Authentication_of_Na...