Hacker News Reader

Comment by lwhsiao | Hacker News Reader

I also suspect a different is when I invoke lychee, I'm running it on ALL of the *.html files output by my static site generator. Perhaps Bernard is only testing a single page?

If I only run lychee on the same single page, the numbers are closer:

> 76 Total (in 1s) 73 OK 0 Errors 2 Excluded

View on HN

No, it follows every link recursively, as long as they are part of the same domain.

So, if you add example.com, the crawl starts at / and all links found therein are added to the queue, and so on. For convenience www.example.com is also considered within crawl scope (and viceversa). Everything else is treated as an external link, so tested but not parsed.

Is it possible that your links are hosted on another subdomain than the one you have entered? I'll do a deeper dive into this issue tomorrow.

Maybe not all pages are reachable from the root.

Cool!

> I'll do a deeper dive into this issue tomorrow.

FWIW, I don't think I'd go as far as calling this an issue, I suspect both Bernard and Lychee are doing different, but reasonable things.

No need to spend much time on my account, and cheers on launching a useful project!

There's why Bernard isn't finding as many links: a sample one from /blog

    <a href="https:&#x2F;&#x2F;luke.hsiao.dev&#x2F;blog&#x2F;2023-workstation-build&#x2F;">My 2023 Workstation Build</a>

I have never seen forward slashes encoded that way. These were simply not recognised. Added to the todo list.

Huh, me neither. Not an intentional encoding on my part. Looks like I have a bug to fix as well!

Reply on news.ycombinator.com