Great post, thank you. You articulated my feeling with ChatGPT models, and one of the reasons I prefer Claude to ChatGPT. I find Claude tries to please less. Anyway, I turned your blog post in a Cursor rule, and told ChatGPT to follow it too, and so far the output is much improved IMO. If you want to try it, the rule is here: https://github.com/davenicoll/cursor-rules/blob/main/.cursor...
Plain language writing necessitates a good editor, just like great cooking needs a proper kitchen and equipment. Certainly, a master chef can cook something amazing on a bare campfire, using literal sticks and stone tools, yet in order to become a true chef one still needs to start in the kitchen.
I always enjoyed writing prose in Emacs, because all the tools I need are always at my fingertips - thesaurus, spellchecking, etymology lookup, dictionaries, translation, search, and these days LLMs as well.
And the level of integration some Emacs packages demonstrate is simply bananas - I can ask LLMs to help me at any point, whether I'm writing some notes, sending a Slack message to a colleague, editing a comment in a codebase or a git commit message, or even when running shell commands. You can easily manipulate the context applied to the conversation, see the payload, repeat with variability, swap models anytime, call external tools, replace things in place, examine the diff of the changes, search through your prior conversations, etc.
I honestly can barely contain my excitement at seeing how my ultimate choice gets vindicated. When I committed to Emacs while the world moved toward newer, shinier tools, it often felt isolating - like swimming against the tide. Then LLMs arrived, and for a moment I wondered if this revolutionary technology would finally render my beloved editor obsolete. Instead, the opposite happened: LLMs integrated so seamlessly into Emacs that the experience surpasses even specialized tools built exclusively for AI interaction. Years of investment weren't wasted - they were preparation for this moment of perfect synergy. The irony is beautiful: the very tool that seemed antiquated to most people keeps proving to be the most adaptable to the future.
I really enjoyed reading this, particularly the first part where the author was specific about why we invariably (and often vaguely) find LLM generated text slightly off.
I cherish writing and find it a wonderful tool for thinking. So far, I've tried to do technical writing without much LLM help. I do run the final writing through a good model to point out factual inaccuracies.
Really good article. I was discussing this with Shreya (the author), and an interesting insight was that prompting a LLM to follow these instructions do not work reliably.
I’ve had similar frustrations. Maybe the next thing to try is fine tuning? Curious what others think.
binarysneaker|8 months ago
iLemming|8 months ago
I always enjoyed writing prose in Emacs, because all the tools I need are always at my fingertips - thesaurus, spellchecking, etymology lookup, dictionaries, translation, search, and these days LLMs as well.
And the level of integration some Emacs packages demonstrate is simply bananas - I can ask LLMs to help me at any point, whether I'm writing some notes, sending a Slack message to a colleague, editing a comment in a codebase or a git commit message, or even when running shell commands. You can easily manipulate the context applied to the conversation, see the payload, repeat with variability, swap models anytime, call external tools, replace things in place, examine the diff of the changes, search through your prior conversations, etc.
I honestly can barely contain my excitement at seeing how my ultimate choice gets vindicated. When I committed to Emacs while the world moved toward newer, shinier tools, it often felt isolating - like swimming against the tide. Then LLMs arrived, and for a moment I wondered if this revolutionary technology would finally render my beloved editor obsolete. Instead, the opposite happened: LLMs integrated so seamlessly into Emacs that the experience surpasses even specialized tools built exclusively for AI interaction. Years of investment weren't wasted - they were preparation for this moment of perfect synergy. The irony is beautiful: the very tool that seemed antiquated to most people keeps proving to be the most adaptable to the future.
bytepoet|8 months ago
I cherish writing and find it a wonderful tool for thinking. So far, I've tried to do technical writing without much LLM help. I do run the final writing through a good model to point out factual inaccuracies.
hamelsmu|8 months ago
I’ve had similar frustrations. Maybe the next thing to try is fine tuning? Curious what others think.
staticman2|8 months ago
"The AI told me splattering em dashes everywhere was what I want—and I, the author of this AI written blog, agrees!"
Slow_Hand|8 months ago