top | item 45023736 (no title) aequitas | 6 months ago Bad guys might download the robots.txt to find out the stuff they don't want them to crawl. discuss order hn newest No comments yet.
No comments yet.