I wonder if "prompt engineering" will be replaced by improvements to LLMs within the next couple years and this is just a bad DX step gap along the journey
Prompt engineering is really more like the art of exploring the emergent behavior of the LLMs. Unlike traditional software that has known features and capabilities. We build a model and then we literally don't know what it does until we explore it.
Short version: I think prompt engineering will be an important skill for a very long time. Using these systems to the maximum of their (currently unknown) potential will always involve expert knowledge!
As long as language is used, prompt engineering will always be a thing. The term "prompt engineering" is just a fancy way of describing being a good communicator.
A good communicator, but also a good sophist. For example, I discovered pretty quick that I could twist the ChatGPT 4 guardrails into knots, even without "DAN" prompts, just by feeding it a lot of philosophical nonsense about semantics and meaning.
You can say whatever you like and live with the results, or try to phrase your communication in a way that elicits the kind of response you want from the other party.
We’ve engineered it away with computers where we learn a programming language or the rules of an operating system and the acceptable input is translated into a deterministic result.
But natural language is much more creative and open ended.
Advances seem to make some of the hacks less necessary (such as CoT behaving better with newlines), but precisely specifying what you want will always be useful.
13years|2 years ago
saliagato|2 years ago
simonw|2 years ago
Short version: I think prompt engineering will be an important skill for a very long time. Using these systems to the maximum of their (currently unknown) potential will always involve expert knowledge!
eddsh1994|2 years ago
ravenstine|2 years ago
crooked-v|2 years ago
awb|2 years ago
You can say whatever you like and live with the results, or try to phrase your communication in a way that elicits the kind of response you want from the other party.
We’ve engineered it away with computers where we learn a programming language or the rules of an operating system and the acceptable input is translated into a deterministic result.
But natural language is much more creative and open ended.
ahzhou|2 years ago
dpflan|2 years ago
alphanullmeric|2 years ago