> Nothing like this will be added to the product. Money comes from scraping content and thus content will be scrapped regardless any non-scrapping hints and we will be actively working on countering anti-scraping measures.
It's kind of tone deaf to launch a tool like this without considering this in the current climate. Not a popular take on hackernews but everyone outside the tech space is pretty pissed about this stuff.
And proxy farms exist solely to get around this problem. If you believe the rights of content creators is the end all be all, don't complain next time Disney tries to extend the IP expiration dates.
pxtail|1 year ago
> Good point! Thanks for the feedback.
> Nothing like this will be added to the product. Money comes from scraping content and thus content will be scrapped regardless any non-scrapping hints and we will be actively working on countering anti-scraping measures.
vunderba|1 year ago
> It has an extensive proxy IP and retry system in place to bypass bot detection.
Seems like a bit of "talking out of both sides of your mouth".
__loam|1 year ago
Onavo|1 year ago