top | item 43465082

(no title)

aaronvg | 11 months ago

It's kind of insane going from 76% to 3% on the new version of a benchmark. We clearly need more rapid progress on the creation of benchmarks.

Then again, I wonder -- if a benchmark is way too hard from the beginning, would it make it much harder for people to test new solutions that actually have real-world impact, even if the new results on the hard benchmark only increased the score by 1%?

discuss

order

artninja1988|11 months ago

The new puzzles seem very hard. Took me quite a while to get some of them