top | item 46040635

(no title)

fzysingularity | 3 months ago

FYI one of the models on the battle was pretty slow to load. Are these also being rated on latency or just quality?

discuss

order

kbyatnal|3 months ago

Ultimately, there’s some intersection of accuracy x cost x speed that’s ideal, which can be different per use case. We’ll surface all of those metrics shortly so that you can pick the best model for the job along those axes.

andrewlu0|3 months ago

ideally we want people to rate based on quality - but i imagine some of the results are biased rn based on loading time

hdjrudni|3 months ago

That's an easy fix if you wait for the slowest one and pop them both in at the same time, no?