This isn't anything new. We've had prompt engineers for a long time now; we've just been calling them "SEO Specialists". The kind of person you'd hire to make sure your Amazon listing has all the necessary magical incantations to land on the first page of search results, that sort of thing.
This is just the next incarnation of trying to shift the output of someone else's algorithm in your favor. Be wary of building a career on top of that. It's very easy for the algorithm owner to change things up and obviate any value you used to provide.
SEO optimization is at the other end. It would be like trying to get your data picked up by the model training. Prompts are equivalent to search queries.
>Notably, chain of thought (CoT) prompting, a recent technique for eliciting complex multi-step reasoning through step-by-step answer examples, achieved the state-of-the-art performances in arithmetics and symbolic reasoning, difficult system-2 tasks that do not follow the standard scaling laws for LLMs https://arxiv.org/abs/2205.11916
It's just software. It takes skill and labor to achieve the outputs you want. Is someone who uses photoshop all day not an artist? Or someone who writes text for a compiler not a programmer?
You've got a huge blind spot if you think prompt engineer isn't already a thing.
Welcome to the last decade of title inflation. Everyone is a "manager" now. A "marketing manager", "product manager", "account manager". No more secretary, it's "executive assistant". It's a perk a company can offer, conferring higher status, at no expense to themselves. So the equilibrium is for other companies to do the same, otherwise the company that gives this cost-free perk outcompetes for talent.
People are graduating watered-down educations, earning inflated cash, with inflated titles. It all helps people believe they're higher status, that they have a university degree and are a manager earning $80k, surely they're getting close to the top of the totem pole now. But they have a worse standard of living and education equivalent to high school in the '60s.
>This morning, I brushed and flossed, which makes me a Plaque Removal Engineer. I then used my skills as a Room Tidyness Engineer to make the bed. After that, I engineered the harness onto my dog and took her on a walk: Canine Fitness Engineer. I engineered the water to a higher temperature using the kettle, and poured it over some coffee grounds to create a chemical reaction in my morning brew: Yeah, that's right, Caffeine Engineer. After this incredibly productive morning, I got in the car and drove to my job as a computer programmer.
At this point the word "engineer" has lost its original meaning. Until there's a formal theory of how we can interact with LLMs and you make use of that in a systematic fashion, "prompt engineering" is really closer to "prompt artist."
The naming might be flawed but it's like a batista I guess. You can spend a lot of money on the machine but without an expert to use it you will not get the best out of it.
I still remeber when Google appeared there were people offering search services for a fee (maybe they were called Search Engineers but I don't recal seeing that).
you can automatically learn soft prompts with backprop so.. the job "prompt engineering" isn't going to stick around for too long given it's automatable.
That is not to say, that integrating LLMs won't create a lot of jobs. Think of it as systems engineering. Knowing how computers work, as well as a software engineer does, will always be useful.
Early in Web, I saw job posts for "HTML Programmer".
(This was before JS, before CSS, etc. Mostly just your original HTML simplified LaTeX article.cls elements, plus `A` and `IMG`, and maybe a `FONT`.)
HTML was easier to use than many word processors, but because it was new and unfamiliar, yet looked like it might be huge... for a brief period, practically anyone who could spell "HTML" or "WWW" could posture as a whiz kid, and make big bucks.
I'd guess that "prompt engineer" will evolve into real careers soon, but the nature of the technology and the role will be very different than it is this quarter.
I've been playing around with generating stories with ChatGPT for a while and...English (or any natural language) is really bad at being specific. I've made progress by learning some specific words to describe the type of scene I want and how much of it I want ChatGPT to generate (such as a scene for just that evening verses a few paragraphs describing weeks of traveling). I've also started getting some intuition for when I've given ChatGPT too much info (it'll cram all the facts in in weird ways) and too little info (it'll get really random and start inserting new characters and stuff).
Having a way to manage the meta aspects of story generation would be a big help.
So, what does being a prompt engineer pay these days? And how do you find a job doing it?
Edit: maybe I should have kept reading.
> Anthropic, founded by former OpenAI employees and the maker of a language-AI system called Claude, recently listed a job opening for a “prompt engineer and librarian” in San Francisco with a salary ranging up to $335,000. (Must “have a creative hacker spirit and love solving puzzles,” the listing states.)
Reading the comments here, there is something to be said about how much naysaying there is in regard to this technology. I should expect it. You see the same pattern everywhere in one way or another. I urge people to shift their mindsets and approach cutting edge technology from a perspective of what it could be in the future, vs what it is today. What I mean is, by the time you realize something has fundamentally changed society, you've missed the train.
In the end what we all value is what solves problems. Those who embrace AI tech and learn to use the tool and work around its flaws will solve more problems than those who don't. This includes coming up with a system to validate the work. Those who use the tool recklessly will create more problems than they solve.
What side are we on here? I've been in the industry for over two decades and I for one cannot wait to command the computer in complex ways in my natural language. I am not threatened by other people being able to do the same. The tool is just a tool. What you build with it is what will separate the "professionals" from the "hobbyists".
Professional prompt engineers:
journalists, police interrogators, detectives and private investigators, most people working in sales, most people working in the judicial system, politicians, many people working in "HR", ... maybe "tech jobs" will no longer be a meaningful designation anymore in a few decades?
I'm currently tinkering on a customer support bot with langchain and gpt3. The bot can answer questions about services and their terms, it can use tools to make bookings and perform some taks like scheduling appointments, in a conversational manner.
It's becoming clear to me that subtle changes in the prompt can lead to bullshit answers and gpt making up facts, despite being specifically told not to do so.
If the prompt reaches some complexity threshold, the output quality goes down visibly. I learned that I have to split the bot into subtasks, each having different, smaller, prompts.
So, yeah, I believe prompt engineering can be a thing. At least for a while, until the models become smarter at understanding what we want from them :)
Hot? I've seen like 3 postings for prompt engineers and all of them had extreme requirements. The idea that prompt engineering will magically one-to-one replace software engineering is ridiculous, the whole point of technology is to make things more efficient which necessarily makes a certain amount of the workforce redundant after it reaches a certain amount of efficiency.
The connection is purely superficial, LLMs and cryptocurrency are two completely different technologies, hype is always going to exist with every popular technology, we need to be able to look at something and evaluate it on its own merit rather than as a function of how popular it is.
I don't know how close AI is to replacing software engineers generally, but pretty sure this prompt engineer job isn't going to age well. And for extra irony, the better they do at their job, the greater will be the dependence upon the tech and the incentive to eliminate the middle-man (ie. the human).
Large models are programmed with prompts. This is really just a “software engineering” job where the programming language looks enough like English to make it look easy.
[+] [-] lampshades|3 years ago|reply
[+] [-] notpachet|3 years ago|reply
This is just the next incarnation of trying to shift the output of someone else's algorithm in your favor. Be wary of building a career on top of that. It's very easy for the algorithm owner to change things up and obviate any value you used to provide.
[+] [-] travisjungroth|3 years ago|reply
[+] [-] mycall|3 years ago|reply
[+] [-] superdisk|3 years ago|reply
[+] [-] vsareto|3 years ago|reply
>https://sites.google.com/view/automatic-prompt-engineer
Not exactly a "toaster go brrrr" job, but it could be obsolete one day
WaPo does need to chill though. There’s barely any Prompt Engineer jobs
Edit: If anyone's curious, I've been following this for prompt stuff: https://github.com/dair-ai/Prompt-Engineering-Guide
[+] [-] usea|3 years ago|reply
You've got a huge blind spot if you think prompt engineer isn't already a thing.
[+] [-] reducesuffering|3 years ago|reply
People are graduating watered-down educations, earning inflated cash, with inflated titles. It all helps people believe they're higher status, that they have a university degree and are a manager earning $80k, surely they're getting close to the top of the totem pole now. But they have a worse standard of living and education equivalent to high school in the '60s.
[+] [-] teaearlgraycold|3 years ago|reply
[+] [-] paxys|3 years ago|reply
[+] [-] abootstrapper|3 years ago|reply
[+] [-] krackers|3 years ago|reply
-mlsu: https://news.ycombinator.com/item?id=34884683
At this point the word "engineer" has lost its original meaning. Until there's a formal theory of how we can interact with LLMs and you make use of that in a systematic fashion, "prompt engineering" is really closer to "prompt artist."
[+] [-] tanto|3 years ago|reply
[+] [-] TrackerFF|3 years ago|reply
[+] [-] cfn|3 years ago|reply
[+] [-] echelon|3 years ago|reply
Well, you do you. That's old world thinking for a field that's going to dramatically morph into something that barely resembles what we have today.
I'm hiring a contract prompt engineer for my startup.
If you want to help us achieve better "TV replacement" results, send me an email (see profile).
https://fakeyou.com/news (early demo, more coming soon!)
[+] [-] unknown|3 years ago|reply
[deleted]
[+] [-] p1esk|3 years ago|reply
[+] [-] andrewstuart|3 years ago|reply
Crazy.
[+] [-] yacine_|3 years ago|reply
https://arxiv.org/abs/2302.06541
That is not to say, that integrating LLMs won't create a lot of jobs. Think of it as systems engineering. Knowing how computers work, as well as a software engineer does, will always be useful.
[+] [-] cfn|3 years ago|reply
Cool paper, BTW.
[+] [-] neilv|3 years ago|reply
(This was before JS, before CSS, etc. Mostly just your original HTML simplified LaTeX article.cls elements, plus `A` and `IMG`, and maybe a `FONT`.)
HTML was easier to use than many word processors, but because it was new and unfamiliar, yet looked like it might be huge... for a brief period, practically anyone who could spell "HTML" or "WWW" could posture as a whiz kid, and make big bucks.
I'd guess that "prompt engineer" will evolve into real careers soon, but the nature of the technology and the role will be very different than it is this quarter.
[+] [-] spaced-out|3 years ago|reply
I've been playing around with generating stories with ChatGPT for a while and...English (or any natural language) is really bad at being specific. I've made progress by learning some specific words to describe the type of scene I want and how much of it I want ChatGPT to generate (such as a scene for just that evening verses a few paragraphs describing weeks of traveling). I've also started getting some intuition for when I've given ChatGPT too much info (it'll cram all the facts in in weird ways) and too little info (it'll get really random and start inserting new characters and stuff).
Having a way to manage the meta aspects of story generation would be a big help.
[+] [-] truculent|3 years ago|reply
[+] [-] ly3xqhl8g9|3 years ago|reply
[1] https://en.wikipedia.org/wiki/Node_graph_architecture
[2] https://blueprintsfromhell.tumblr.com
[+] [-] lampshades|3 years ago|reply
Edit: maybe I should have kept reading.
> Anthropic, founded by former OpenAI employees and the maker of a language-AI system called Claude, recently listed a job opening for a “prompt engineer and librarian” in San Francisco with a salary ranging up to $335,000. (Must “have a creative hacker spirit and love solving puzzles,” the listing states.)
[+] [-] Art9681|3 years ago|reply
In the end what we all value is what solves problems. Those who embrace AI tech and learn to use the tool and work around its flaws will solve more problems than those who don't. This includes coming up with a system to validate the work. Those who use the tool recklessly will create more problems than they solve.
What side are we on here? I've been in the industry for over two decades and I for one cannot wait to command the computer in complex ways in my natural language. I am not threatened by other people being able to do the same. The tool is just a tool. What you build with it is what will separate the "professionals" from the "hobbyists".
[+] [-] grufus|3 years ago|reply
Maybe they realized that too many jumped on the blockchain BS train.
[+] [-] simonw|3 years ago|reply
[+] [-] staunton|3 years ago|reply
[+] [-] tymonPartyLate|3 years ago|reply
[+] [-] unknown|3 years ago|reply
[deleted]
[+] [-] antibasilisk|3 years ago|reply
[+] [-] WesolyKubeczek|3 years ago|reply
[+] [-] smcl|3 years ago|reply
[+] [-] root_axis|3 years ago|reply
[+] [-] ur-whale|3 years ago|reply
Did crypto crash?
Last I looked BTC was at 20K USD a pop ... strange definition of a crash for something that used to trade below a dollar.
[+] [-] ed-209|3 years ago|reply
[+] [-] taylorius|3 years ago|reply
[+] [-] spoonjim|3 years ago|reply
[+] [-] I_AM_A_SMURF|3 years ago|reply