[mattew]

Don’t forget classification. Even the zero shot classification can be quite decent, but put a solid prompt together, or fine tune a set of examples and it’s way easier with an LLM than previous methods in my experience.

[blueboo]

My favourite extant example of this GPT4’s 18-way rule-based reward model classifier, appendix A https://cdn.openai.com/papers/gpt-4-system-card.pdf