top | item 46069202

(no title)

someplaceguy | 3 months ago

> Okay, that's not fair. There's a big advantage to having an external compressor and reference file whose bytes aren't counted, whether or not your compressor models knowledge.

The benchmark in question (Hutter prize) does count the size of the decompressor/reference file (as per the rules, the compressor is supposed to produce a self-decompressing file).

The article mentions Bellard's work but I don't see his name in the top contenders of the prize, so I'm guessing his attempt was not competitive enough if you take into account the LLM size, as per the rules.

discuss

order

Dylan16807|3 months ago

The benchmark counts it but the LLM compressor that was linked in that sentence clearly doesn't count the size.