Crawlable – We audited 50 top web apps for AI crawler readability

Consider LLMs.txt and AGENTS.md when auditing. Those make a significant difference in readability.