top | item 39232956

(no title)

guizzy | 2 years ago

I don't have it set up to publish a website, but maybe you'll be interested in this tool I made for myself. https://github.com/GuizzyQC/FeedSummarizer

It will take an RSS feed, send the content of x number of articles to an OpenAI-compatible API to summarize, then send me an email with all of those summaries. I have it set to run every day so I wake up to a summary of my feeds (and of Hacker News).

I figure it would not be too difficult to feed the contents to a static site generator.

discuss

Karrot_Kream|2 years ago

Have you had any trouble with BeautifulSoup? I've thought about doing something similar but wanted something more robust with scraping. I've thought about using Puppeteer.

guizzy|2 years ago

It works pretty well. This morning running on what were the top 20 articles on Hacker News, it failed to extract data for one article and that was only because the link was a PDF. On an average day I get one or two failure per 20 articles, for various reasons (click-throughs, information in pictures, PDF links) and I haven't tried very hard to improve it.