top | item 46612254

(no title)

Jeremy1026 | 1 month ago

I sysadmin my kids' PTA website. OpenAI was scraping it recently. I saw it looking at the event calendar, request after request to random days. I saw years 1000 through 3000 scroll by. I changed the response to their user agent to an access denied, but it still took about 4 hours for them to stop.

discuss

order

tonyedgecombe|1 month ago

I wonder who wrote a crawler like that. Oh wait ...

jwe|1 month ago

I can't follow your thought there. Who wrote it?