Totally blind in my case though, but the virtual game part was about the prompt. On the other hand, it would be interesting to see if the visual information in a virtual game could be communicated in alternative ways. If the computer has meta info about the 3d objects instead of just rendering info on how to show them, it might improve the accessibility somewhat.
Also with the rapid advances of vision language models, I would be surprised if we don't see image-to-text-to-voice system that works with real-time video in a not-so-far future! Like a reverse "Genie" where instead of providing a prompt and it generates a world, you provide a streaming video and it spouts relevant information when changes happen, or on demand, for instance...
gostsamo|6 months ago
antx|6 months ago