Crawl4AI is an open-source, LLM-friendly web crawler and scraper

Here is the website and docs: https://docs.crawl4ai.com/

sweet, i am testing this out