Deep Learning Benchmarks

[jimfleming]

It's nice to see Leaf coming along so well. Part of me would love to be able to build models in rust.

For more benchmarks (including updated TensorFlow performance with cudnn v4) see https://github.com/soumith/convnet-benchmarks

[mjhirn]

I just patched the link on the landing page to the repo [1] and updated benchmarks for Leaf 0.2 + cuDNN 4 for Overfeat and VGG. But I couldn't get Torch and Tensorflow running with cuDNN 4, yet.

[1]: https://github.com/autumnai/deep-learning-benchmarks

[narrator]

Too bad Tensorflow Cuda only works with the top of the line NVIDIA cards that cost over 1k.

[reality_hacker]

Just curious, does this benchmark include models quality somewhere?

[viksit]

Curious - no Theano benchmarks?

[mjhirn]

We would love to include those, but we didn't find the implementation for the tested models for Theano, yet. Do you have link? You can also submit your own Benchmarks via PR, if you'd like to.

[Houshalter]

For benchmarks of classification results of different algorithms and methods, there is this: https://rodrigob.github.io/are_we_there_yet/build/classifica...

[waleedka]

I hope the TensorFlow team is working on improving its performance. Anyone know if they're working on that?

[vrv]

Indeed we are. Here's a recent commit from today https://github.com/tensorflow/tensorflow/commit/d6f3ebfdfc1d... :)