In a past job I’ve seen crappy crawlers from badly designed security applications do stuff like this. An an example one customer was using Trend CAS to scan all URLs in their inbound email. This causes big bursts of traffic on our systems.
The crawls came from Azure and AWS. Forged UAs, repeat hits in the same URL, etc.
No comments yet.