[gbertb]

how are the links structured in the ahref tag? is it relative or absolute? if relative, then thats prob why.

[babuskov]

Relative.

For example, the page:

https://website/blog/1-post

contains:

href="2-post"

Browsers and other bots like Google Bot correctly interpret this as a link to

https://website/blog/2-post

While OpenAI crawler goes to:

https://website/blog/1-post/2-post

I wonder is there some way to report this bug to them?

[fullstackwife]

Google recommends absolute urls:

https://web.archive.org/web/20221208150134/https://www.webma...

[AznHisoka]

I actually think OpenAI is right, unless you have a base url tag? That’s a relative url and its relative to the current url you are on, not the root domain