top | item 32907247

(no title)

unixbane | 3 years ago

I'm saying anti-scraping is a misconception and if you buy it (or get one for free) you just paid for a placebo and it's also worse than nothing. Is there anything confusing about this?

discuss

order

vntok|3 years ago

I don't want you scraping my sites, and I can see the hundred of thousands of requests from scrapers/bots blocked by Cloudflare. Seems like it works here.

simondotau|3 years ago

If it's a misconception, why did you complain that Cloudflare caused you "a really hard time making a web scraper"?

unixbane|3 years ago

You just confused me with someone else. Cloudflare gives me a hard time as a user only. When you view a page with a proxy or shared IP address, you have to solve a captcha or enable JS to see any text with @ in it, and such insanities. Scraping is a user use case. Web crap is meant to be automateable and automatically navigible (though as a cattle user who sees it as an interactive one time experience, like someone walking into a shop, I can see how you see otherwise). Anyway it's easy to scrape even with Cloudflare, it just causes more bumps and adds to your fingerprint and makes the internet as a whole more insecure.