Automating IDEs: Who's Working on It?

[saran945]

With modern screen automation capabilities, is anyone working on automating IDEs like Cursor/VS Code ?

Key requirements:

1. UI agents with a knowledge base – Integrating IDE documentation, dev docs, and contextual intelligence. 2. Expert UI traces for optimal actions – Capturing and replaying efficient workflows.

Would love to hear thoughts, projects, or ideas on making IDEs more autonomous.