This is very interesting. Do you support Azure or even custom hosting?
Once the model is deployed do you monitor things besides performance? Such as I/O to the model, data drift, etc?
Yes, model metrics are monitored when deployed -- performance metrics are enabled by default, and feature / prediction monitoring depends on the framework you're using. You can take a look at an example here: https://app.modelzoo.dev/models/gpt2-twitter-vc?tab=metrics.
We do support deploying to a private AWS cloud in our private beta that we can help get you set up with. Azure is not yet supported for private deployments.
yoavz|5 years ago
We do support deploying to a private AWS cloud in our private beta that we can help get you set up with. Azure is not yet supported for private deployments.