We decided not to offer HTTP-based (file-based) validation via randomly-generated subdomains for wildcards in part because if you're required to set up random subdomains you're modifying DNS to do that, and if you're already modifying DNS you might as well just use the DNS validation method.
1. Namecheap's API is rubbish - extremely rate limited so after doing 2 or 3 in an hour it basically stopped working
2. Propagation delays - I don't know if this was provider specific for Namecheap and Gandi, but sometimes lego would just hang waiting for LE to confirm propagation.
HTTP challenge works fine and is far easier if punched into the load balancer rather than relying on each back end.
Note note of these problems are the fault of LE from what I see. I'm going to see if any of the ACME clients support updating Google Cloud DNS which I use now, as their propagation time seems minimal.
Thanks for your work btw in securing the internet.