I think people have been experimenting with integrating stable diffusion into text adventure games (like AI Dungeon) for a while now.
Prompt adherence is always an issue particularly in a text adventure game where position matters - e.g. (The crystalline amulet is sitting on top of the old wooden table. A fireplace at the end of the room gently crackles. To the east lies a door, cracked with age. On the west wall you can see a painting of the lords of the manor. etc)
Flux could probably get close - though it clearly doesn't have any examples of an amulet in its training data. :)
The later Infocom games — I’m thinking especially Moriarty’s evocative Wishbringer, Trinity, Beyond Zork — have much improved writing in general; it might be interesting to see what an LLM actually does with those.
DonHopkins|1 year ago
133 points by mr_walsh on Jan 8, 2023 | hide | past | favorite | 54 comments
https://news.ycombinator.com/item?id=34300765
https://www.youtube.com/watch?v=ZpCrBBj6AWE
vunderba|1 year ago
Prompt adherence is always an issue particularly in a text adventure game where position matters - e.g. (The crystalline amulet is sitting on top of the old wooden table. A fireplace at the end of the room gently crackles. To the east lies a door, cracked with age. On the west wall you can see a painting of the lords of the manor. etc)
Flux could probably get close - though it clearly doesn't have any examples of an amulet in its training data. :)
https://imgur.com/a/giBqQ1L
MetaWhirledPeas|1 year ago
KerrAvon|1 year ago
adamrezich|1 year ago
gonzus|1 year ago