top | item 46795936

(no title)

schmidtleonard | 1 month ago

I can't believe parallel processing is still this big of a dumpster fire in python 20 years after multi-core became the rule rather than the exception.

Do they really still not have a good mechanism to toss a flag on a for loop to capture embarrassing parallelism easily?

discuss

order

ritchie46|1 month ago

Polars does that for you.

skylurk|1 month ago

This is one of the reasons I use polars.

lairv|1 month ago

Well I think ProcessPoolExecutor/ThreadPoolExecutor from concurrent.futures were supposed to be that