Fall back to provided URL if no canonical URL found about page-metadata-parser HOT 3 CLOSED

Interesting fact, Reddit has bogus canonical URLs (for homepage and subreddits, but seemingly not article pages). Filed a bug for it in /r/bugs: https://www.reddit.com/r/bugs/comments/4zr43f/meta_canonical_links_are_bogus/

1. https://www.reddit.com

   <link rel="canonical" href="https:///" />

2. https://www.reddit.com/r/bugs/

   <link rel="canonical" href="https:///r/bugs/" />

3. https://www.reddit.com/r/bugs/comments/4zr43f/meta_canonical_links_are_bogus/

   <link rel="canonical" href="https://www.reddit.com/r/bugs/comments/4zr43f/meta_canonical_links_are_bogus/" />

UPDATE: Reddit is very efficient and pushed out a fix to prod in <48h: https://www.reddit.com/r/bugs/comments/4zr43f/meta_canonical_links_are_bogus/d71vps5

from page-metadata-parser.

Not sure if you want me piggybacking on this issue, or starting a new one, but we may also have to add a processor to the canonical URL check to make sure that THAT URL is absolute, because apparently Vimeo isn't:

$ meta-scraper -u  "https://vimeo.com/180763356"

...
<link rel="canonical" href="/180763356">
...

from page-metadata-parser.

@pdehaan oh interesting good catch on relative canonical urls!

from page-metadata-parser.