Top Problems with LLM App Development

[devilankur18]

Please share top 3 development/production problems that you have faced in order of priority.

[tacosbane]

1. the model's responses are unreliable 2. to make them reliable, you have to tell the model the answer 3. even though you now have a process to figure out the answer, you still have to use the model because the VP wants you to

[throw03172019]

- getting access to bigger models - getting enough RPM once approved - testing prompts against each other to determine what is the winner in development

[devilankur18]

where problem do you think take the most time ?