As a SWE, my preferred export format would be a folder with a Dockerfile. I'm not sure how GPUs work with docker, but if I could just run the container on a machine with a gpu, or deploy it into a k8s cluster with an affinity for a node with a gpu, that would be my ideal. I'm not sure how I'd want model drift to be addressed, so being able to pull down and deploy new versions would be something to consider as well.
saintarian|4 years ago