Ask HN: How are you managing your prompts?

[toomuchtodo]

How are you cataloging, maintaining, versioning your prompts? Are you relying primarily on one toolchain where they are organizing by default in the toolchain interface (but locked in the toolchain)? Or are you using some other mechanism? Are you using a mechanism that enables you to share and permission them with team members, colleagues, friends?

The intent with this inquiry is to improve my own workflow(s) and potentially those of others interested in this topic. Thank you!

[paulcole]

I don't do this at all. I find that being obsessed with optimizing prompts is exactly what's not needed at this stage of AI's development.

I just prompt as I go and find that the "cost" of prompting again to get a better output is lower than the cost of having some system for cataloging, maintaining, and versioning my prompts.

I might be wrong but I'm getting good results out of LLMs.

[tra3]

There are complex prompts that are worth fine tuning. For me, it’s prompts that require a bunch of context. For example, vacation planning. Include a bunch of requirements, so it turns into a 1000 words essay, but it’s worth it to store it and reuse it.

Or a personal assistant. I have a text based workflow but explaining it to an llm takes yet another 1000 word essay. I would benefit from a workflow that lets me reuse and version prompts.

[sebastiennight]

To clarify, you seem to be asking about end-users storing their (eg. ChatGPT) prompts, not software devs managing the prompts they use in the API?

These are two very different questions.

[toomuchtodo]

Both actually, as I think there is a lot of overlap between the use cases. Someone mentioned to me that they recently "graduated" from using the Mac ChatGPT app to something more robust, for example, due to how many prompts they were managing and the systems they were submitting them to. I would also be interested in your perspective why these are vastly different (user prompts vs system prompts), as I might be missing context.

[runjake]

Past discussion, which may be helpful:

Ask HN: How do you manage your prompts in ChatGPT? https://news.ycombinator.com/item?id=41479189

I'm curious to see how people's workflows have changed.

Us, we manually catalog them in well-named Markdown files and folders and store in a git repo. I would like a more taxonomical approach.

[hchak]

promptlayer is great. Highly recommend for prompt versioning, play grounding, etc.

[tra3]

“Start for free” and no “pricing” available. Am I missing it, or what’s the monetization strategy here?