[bodantogat]

I feel the pain — it’s very difficult to detect many of the less ethical scrapers. They use residential IP pools, rotate IPs, and provide valid user agents.

[ranger_danger]

And many proxy/scraping providers now use real browsers that can automatically bypass cloudflare captchas as well, and a bot with a real browser similarly won't be clicking on any invisible links, so... I am skeptical just how long this will make an appreciable difference.

[trollbridge]

So what you’re saying is that a CAPTCHA cannot actually T C and H A.

[everybodyknows]

> residential IP pools

So, is this a new profit center for sleazeball household ISPs?

[vbernat]

No, this is done by paying app developers to bundle some random SDK. Search for Bright Data.

[jeroenhd]

"Residential proxy" is just a word for a botnet. Apps and programs come with a trojan built in that offers your device as an exit node to "monetize" their apps.

It "residential proxy" sounds a lot better when you're talking to VC investors, though.

[mlrtime]

"free" vpns do this.