[vineyardmike]

No.

Computer use (to anthropic, as in the article) is an LLM controlling a computer via a video feed of the display, and controlling it with the mouse and keyboard.

[dbbk]

That sounds weird. Why does it need a video feed? The computer can already generate an accessibility tree, same as Playwright uses it for webpages.

[0sdi]

So that it can utilize gui and interfaces designed for humans. Think of video editing program for example.

[lsaferite]

I feel like a legion of blind computer users could attest to how bad accessibility is online. If you added AI Agents to the users of accessibility features you might even see a purposeful regression in the space.

[chasd00]

> controlling a computer via a video feed of the display, and controlling it with the mouse and keyboard.

I guess that's one way to get around robots.txt. Claim that you would respect it but since the bot is not technically a crawler it doesn't apply. It's also an easier sell to not identify the bot in the user agent string because, hey, it's not a script, it's using the computer like a human would!

[jebus989]

Even simpler it just takes screenshots (or at least that's what it was doing last time I used it)

[cowboylowrez]

oh hell no haha maybe with THEIR login hahaha