[joe_91]

Instead of focusing solely on the "market boom" and technological advancements, we should be having a serious conversation about the societal implications and the long-term sustainability of this scraping free-for-all.

The "higher stakes" mentioned aren't just about cost and effort; they're about the potential erosion of online privacy, the destabilization of websites reliant on ad revenue, and the ethical responsibility of data practitioners.

It would be interesting to explore ways of profit sharing to cover loss of ad revenue, better caching to reduce the cost on websites themselves, and simple ways to opt in or opt out of personal information being used online!