top | item 45210678

(no title)

Forgret | 5 months ago

Thanks, you’re absolutely right — performance needs to be tested on large inputs with proper speed and memory profiling. I’ll run FSP on bigger datasets and compare it directly with zstd, brotli, gzip, etc. If needed, I’ll improve the algorithm to reduce overhead and make it scale better. This was just an early proof-of-concept, but I agree the next step is serious benchmarking.

discuss

order

southwindcg|5 months ago

You've got some stiff competition out there, with companies like Google and Facebook funding development of these algorithms. I think the days of individual coders surpassing the current state of the art are gone. It's in the interest of companies that move huge amounts of data to be as efficient at it as possible.

It's definitely interesting that your method competes with Zip and such though. Keep it up!

Forgret|5 months ago

Thanks for the inspiration! I realize it’s probably crazy to think my algorithm could ever become universally needed, but I’m not giving up. Even if it doesn’t turn into something as large-scale as I once dreamed, I believe it can still lead to something useful — and the journey itself is worth it.