But why even implement a duplicate link checker without putting more effort into parsing the uri string for obvious gotchas like whether there's a trailing slash, or extraneous but meaningless query parameters?
Coding checks such as those are pretty tedious. It's not hard, and that's why it's not interesting.
Sure, but even with pet projects you can't expect everything to be fun. I'm just suggesting that if pg considers duplicate links a problem worth solving in his application, then the extra effort might be worth the tedium.
And if he doesn't, then he doesn't.
The fact that this question keeps coming up and it doesn't get changed indicates that it isn't a problem he cares about.