Hacker News Reader

> Monitoring the server logs showed that Bingbot only crawled the lowercase version of the URL.

I've always thought it was much more common that sites written in ASP.Net have case-sensitive URLs. At least that was quite common ~5 years ago (was it a default setting or something? I haven't done .Net stuff in a while). So it's pretty crazy that Bing only crawls lowercased URLs.

View on HN

That's overstating the "case" (pun!). Ignoring or normalizing case is different from ignoring a non-redundant URL with uppercase.

But it might cause problems if the IIS server isn't properly case-preserving to normalize back to the standard (possibly capitalized) form.

Mac filesystem was nicely case-preserving but case-agnostic in this way, going back decades.

It’s still like this by default, which can cause issues when working with folders created on other platforms.

I've found bing explicitly requesting lower-case versions of my urls despite mixed case being submitted in the sitemap.

Now I either 301 redirect to the proper-case url or ensure I have canonical tags set up.

Reply on news.ycombinator.com