top | item 38832510

(no title)

lbalazscs | 2 years ago

The ONNX Runtime is written in C++ and it uses the GPU. And Java is certainly much faster than Python.

discuss

order

rvz|2 years ago

That means nothing if one uses an inefficient language for both inference and training and the slower language will still bottleneck the ONNX runtime FFI calls and on top of Java's own garbage collector.

For those that care about performance know that the worst case is taken into account regardless if it is written in C++ for both memory and runtime performance.