(no title)
greggyb | 3 months ago
But because each step of the pipeline is a separate process, you get the N executables of the pipeline all able to run on separate cores.
I am not trying to say that every workload will benefit from this, or that such coarse parallelism is optimal for all use cases. But the fact that it is free with no changes to the pipe, the pipeline, or any of the executables is incredible.
anthk|3 months ago