What are the mechanics of doing that? How do you tell it what page to open, how far to scroll, what exactly you want to hear about, and how do you plug that into the model and get a result?
- scraping is relatively dumb and straightforward. I use playwright to login and just scroll my timeline for the first 100 tweets. I run the thing every 3 hours right now, but definitely could tweak the number of tweets vs frequency
- I only care about AI tweets really on my timeline, so filtering to that is pretty straightforward just passing it to GPT
- I included the prompts in the link. Definitely far from perfect, but it works well enough. It does surprisingly suck sometimes, like I've noticed that it doesn't always pick up on tweets about LangchainAI despite AI being in the name etc
Sure thing - but just FYI I really only care about AI tweets in my timeline, so YMMV if you want it to summarize your timeline in general. I tried a generic "summarize my timeline" approach before and it didn't work well. Filtering to within a certain topic seems to really help
lordnacho|2 years ago
turkeygizzard|2 years ago
- scraping is relatively dumb and straightforward. I use playwright to login and just scroll my timeline for the first 100 tweets. I run the thing every 3 hours right now, but definitely could tweak the number of tweets vs frequency
- I only care about AI tweets really on my timeline, so filtering to that is pretty straightforward just passing it to GPT
- I included the prompts in the link. Definitely far from perfect, but it works well enough. It does surprisingly suck sometimes, like I've noticed that it doesn't always pick up on tweets about LangchainAI despite AI being in the name etc
Semonto|2 years ago
Awesome loving that.
Will keep this workflow in mind when personal gpt models are out.
mrleinad|2 years ago
turkeygizzard|2 years ago
https://github.com/purpleladydragons/ai-sanity