top | item 29911545

(no title)

RobSm | 4 years ago

No. robots.txt is not something that is defined and enforced by the law. Just because someone came up with some 'recommendation' like robots.txt does not mean this is the law

discuss

order

shukantpal|4 years ago

> Legal? Yes. Parasitic behavior? Also yes.

You failed to make a meaningful counterpoint; the legal/ethical distinction was made clear in the parent post.

LamaOfRuin|4 years ago

As a matter of fact, robots.txt is a well understood expression of intent which is legally meaningful in a lot of contexts.