top | item 41682910

(no title)

jonathanyc | 1 year ago

I haven't seen any information that could be used for this in the RSS feeds I've looked at. You could scrape the website, especially if it's all running on your own computer, but if you do it on a server you'll almost certainly be blocked unless you use a third-party scraping service. The WSJ in particular is super aggressive; you'll probably be OK with the NYT, which has a personal use exemption.

Unfortunately Anthropic and OpenAI have kind of ruined scraping for everyone else.

discuss

order

No comments yet.