top | item 13866808

(no title)

gnipgnip | 9 years ago

Sadly you can only share pickleable objects in python multiprocessing.

discuss

order

radarsat1|9 years ago

Or shared memory: http://stackoverflow.com/questions/5549190/is-shared-readonl...

(but it's a little hacky..)

sdbrown|9 years ago

A little hacky, yes, but extremely effective. I wrote an image processing application for somewhat large time-series datasets (> 1TB) on Linux which took liberal advantage of these details to run very nicely on v2 Xeon processors. It also worked quite well for GUIs which interacted with the datasets.

cocoablazing|9 years ago

Still, multiprocessing objects like Array and Manager are limited to ctypes.