[shakna]

> The issue is other sites really want to know if it's a link to the same resource or a different resource.

Thats what the canonical link is for, isn't it? [0]

RFC 6596 introduced it in 2012. Other websites, like search engines or social media, have been using it for a while.

[0] https://developers.google.com/search/docs/crawling-indexing/...

[socalgal2]

Yes, and? That’s a boil the ocean solution. Every app and site needs to look up urls and update where as they didn’t before.

[shakna]

Most apps and sites will have a thumbnail for the site. So they're already loading the page.

Other sites grab contact information or verification headers. So they also load the page.

Seems like the only people who wouldn't want to load at all, would be those places where deduplication doesn't matter in the first place.