top | item 39670869 (no title) pillusmany | 2 years ago The "ray" library makes running python code on multi core and clusters very easy. discuss order hn newest kroolik|2 years ago Although its great the library helps with multicore Python, the existence of such package shouldnt be an excuse not to improve the state of things in std python smcl|2 years ago Interesting - looking at their homepage they seem to lean heavily into the idea that it's for optimising AI/ML work, not multi-process generally. pillusmany|2 years ago You can use just ray.core to do multi process.You can do whatever you want in the workers, I parse JSONs and write to sqlite files.
kroolik|2 years ago Although its great the library helps with multicore Python, the existence of such package shouldnt be an excuse not to improve the state of things in std python
smcl|2 years ago Interesting - looking at their homepage they seem to lean heavily into the idea that it's for optimising AI/ML work, not multi-process generally. pillusmany|2 years ago You can use just ray.core to do multi process.You can do whatever you want in the workers, I parse JSONs and write to sqlite files.
pillusmany|2 years ago You can use just ray.core to do multi process.You can do whatever you want in the workers, I parse JSONs and write to sqlite files.
kroolik|2 years ago
smcl|2 years ago
pillusmany|2 years ago
You can do whatever you want in the workers, I parse JSONs and write to sqlite files.