top | item 40137882

(no title)

ng-henry | 1 year ago

Yep this is only for stuff that we've crawled, so we can't detect all of your links. Because we have limited crawling resources, we rate-limit the crawling by domain so we don't get stuck in spider traps.

The current visualization only shows the current state of the crawl, so it won't know about all of the posts.

discuss

order

No comments yet.