Here's a python script to find the rss url on a science journal's website. It leverages smolagents and meta-llama/Llama-3.3-70B-Instruct. The journal’s html is pulled with a custom smolagent tool powered by playwright. Html parsing is handled by a CodeAgent given access to bs4.
I've tested with nature, mdpi, and sciencedirect so far.
I built it b/c I tired of manually scanning each journal's html for rss feeds, and I wanted to experiment with agents. It took a while to get the prompt right.
samesense|1 year ago
I've tested with nature, mdpi, and sciencedirect so far.
I built it b/c I tired of manually scanning each journal's html for rss feeds, and I wanted to experiment with agents. It took a while to get the prompt right.
Suggestions welcome.