[cardosof]

As a customer, I want the best product, not the best LLM. The race is far from over and it's not just about having the biggest model in the room.

[drcode]

literally all I want is the best llm

[spacebanana7]

The best LLM for some might be a raw untuned Llama model so they can express more complex prompts, others may prefer the conversional tuning of ChatGPT or the live data available to Bing/Bard.

At present, I don’t think any of these top tier models entirely dominate the other. Each has different pros/cons.

Fundamentally, there must be some trade off between tuning and expressiveness, model size and training frequency (relevant to live data) and possibly a few other performances metrics not well understood yet.

I suspect LLMs will be like databases in that different models will be used in different domains.

[pryelluw]

Not being pedantic but genuinely curious as to how you would define or measure “best”?

I can imagine some kind of multipoint benchmarking in the near future. What do you think?