[ghostbust555]

Asked about this before. I was told no one cared since the real work is done in C and would not benefit from pypy. So the python level optimizations would not affect much.

[entilzha]

Not entirely true. For good utilization you need both GPU/TPU ops to be fast (written in C), but that won’t get you far if your input pipeline (possibly written in python) is slow. I could imagine if all the TF calls work in PyPy, that it would help with throughout by speeding up the input pipeline and keeping the GPU/TPU saturated more effectively. One solution is to write everything to TFRecords, but for experimentation that’s kinda annoying.

[RocketSyntax]

Ah, I figured it was all Python. Now it makes sense why tensor objects are such a pain to work with.

C++ 60.6% Python 30.6%