MLflow: An Open Source Machine Learning Platform

[rememberlenny]

If you are looking for a dependable, scalable, closed-source option, check out http://www.comet.ml (the thing I work on).

The focus with Comet.ml is more on experiment tracking and hyperparameter optimization rather than model deployment. We make it very easy to compare your experiments results, code, and hashed datasets for better reproducibility.

We have a one-line integration with your existing machine learning code and make it stupid simple to start tracking your experiments.

All you do is:

  > import comet_ml
  > experiment = Experiment(api_key="MY_API_KEY")

_boom_

Comet.ml supports many libraries (keras, tensorflow, scikit-learn, custom-built code spaghetti, and everything else that makes you a ML wizard/unicorn/armored flaming hippopotamus).

  ++ Its free for public projects and academics.

[tchalla]

What are the current open source alternatives to MLflow?

[hcrisp]

Sacred (https://github.com/IDSIA/sacred)

FGLab (https://kaixhin.github.io/FGLab/)

Metricmachine (https://github.com/danielwaterworth/metricmachine)

Non-open source:

Neptune (http://neptune.ml)

Aetros (https://aetros.com/trainer)

[mmq]

Polyaxon, https://github.com/polyaxon/polyaxon, is an alternative project to MLFlow that is also open source.

disclaimer: I am the author of Polyaxon.

[TheIronYuppie]

I would imagine Kubeflow (https://github.com/kubeflow/kubeflow) would be complimentary (e.g. run MLFlow on top of it) - they claim platform neutrality.

Disclosure: I work at Google on Kubeflow.

[agnokapathetic]

https://www.mlflow.org is open source.

[daveguy]

https://pachyderm.io is a data science infrastructure framework that has both open source and enterprise versions.

[marcuniq]

RiseML seems to be another alternative: https://riseml.com/

Not open source though

[allisterb]

ClassifyBot https://github.com/allisterb/ClassifyBot

Designed to automate and make repeatable different stages in classification pipelines. Written in .NET but agnostic about language or framework. Embeds a Python interpreter and can interface with Java or R.

Disclaimer: I am a walrus

[shakedown1]

A couple more alternatives:

H2o: https://www.h2o.ai/h2o/ Data Robot: https://www.datarobot.com/

[phltech]

Also not open source, but looks similar to what ParallelM does http://www.parallelm.com

[axilmar]

There is also Orange, although I am not sure it is 100% related to MLFlow. Orange is a joy to use though, so even if it doesn't solve all the problems solved by MLflow, it's worth to be mentioned in this context.

[riku_iki]

So, what MLflow can do more efficiently, than Tensorflow?

[nicolewhite]

I can't tell if you didn't read the article or are asking for a comparison between this and, say, TF's Experiment class.

[stochastic_monk]

It isn’t a deep learning framework. It’s closer to a LIMS system.

[tafycent]

FYI typo: mlflow.log_atrifact("roc.png")