Gwern shared an idea how to exploit the strength of current-generation LLMs, despite their weaknesses, for "create your own adventure"-style fiction. https://gwern.net/cyoa Having people vote on AI-generated potential continuations should yield better results and cut costs at the same time.
From the title I thought this was an implementation of Gwern's idea, but it's not.
There have been experiments in wiki-style cyoa generation (letting the public create options instead of an LLM), but they suffer the same problem as LLM-generated stories: aimless wandering and lack of consistency.
(As I think about it, an LLM generation should be thought of as a many-author situation, as each generation comes in cold)
Stories need pacing, which exists over many passages, not just at the choice level. And then the passages should all be based on a single underlying world. Both of these fall apart quickly without a guiding author.
I think this is resolvable with LLMs and appropriate prompting, but the naive approach seems cool only until you actually play out a few stories
ianbicking|11 months ago
(As I think about it, an LLM generation should be thought of as a many-author situation, as each generation comes in cold)
Stories need pacing, which exists over many passages, not just at the choice level. And then the passages should all be based on a single underlying world. Both of these fall apart quickly without a guiding author.
I think this is resolvable with LLMs and appropriate prompting, but the naive approach seems cool only until you actually play out a few stories
th0ma5|11 months ago
lawlessone|11 months ago
So the story never ends?