I am not going to claim myself if this is "right" or "wrong" but there is some work on that being done via https://datatracker.ietf.org/doc/draft-ietf-dnsop-svcb-https... - see https://blog.cloudflare.com/speeding-up-https-and-http-3-neg...