top | item 41125650

(no title)

corn13read2 | 1 year ago

yes only big conglomerates now can scrape pages. If you're not google stealing the info then...... Right?

discuss

order

jakubsuchy|1 year ago

I didn't say that but a site owner should have the right to decide.

In addition, this scraper doesn't even identify itself (I checked). It pretends to be a normal browser, without saying it's a scraper.

talldatethrow|1 year ago

I think a website owner can decide. They can take the site down, or they can put it behind some kind of user wall.