I agree - out of the box, a LLM will write an extremely poor essay. But that is not how to use the LLM. WHat you do, is give the topic to the LLM, and say, "with this topic, what are 20 titles that I could have for essays." Then, you pick the best title, and you then say, "I am writing an essay with the title <insert title>, what should the central argument for the essay be?" You then ask for a list of bullet points for the central theme of each paragraph to elaborate on that argument, then you ask it to write each paragraph individually, then you put the pieces together, and ask it to proof read it's own work and finally you add in some references of your own. Within 1/2 an hour, you have a passable essay. And if you then iterate on it with the LLM you can fairly soon have a half decent one, especially if it is a well trodden area (presumably with lots of training data that the LLM draws on).I tried to get students to critique things, but even then you can put in the text to critique to a LLM with a long enough context, and the LLM will kick off with a passable critique, if you iterate with it enough.
So, even though they'll never get a top mark, they will still be able to get through the assessment. So I don't set essays any more.
dan-robertson|2 years ago