[0sdi]

So that it can utilize gui and interfaces designed for humans. Think of video editing program for example.

[dbbk]

Yes. GUIs expose an accessibility tree.

[bowsamic]

Even if they do (often not the case) this will be far from exhaustive, and likely won’t reflect the structure of the application very well. Vision based testing is often combined with accessibility based testing

[slopinthebag]

Not all of them do, and not all of the ones that do expose enough to be useful to the AI.