[nayroclade]

The models they tested are already way behind the current state-of-the-art. Would be interesting to see if their results hold up when repeated with the latest frontier models.

[StilesCrisis]

I think we have all seen the latest models turn into a hot mess.

[louiereederson]

i interpret figure 2 as showing that incoherence increases with model gens, albeit on a small sample size