[muricula]

Is that a CPU based inference build? Shouldn't you be able to get more performance out of the M3's GPU?

[wmf]

Inference is about memory bandwidth and some CPUs have just as much bandwidth as a GPU.