COG

Cog is an open-source command-line tool for packaging ML models, making it easier to develop, train and share or deploy them. It does this by automating the setup of a consistent environment across platforms such as your laptop, GPU machines and other people’s devices. Cog also simplifies the process of turning your model into a Docker image that can serve a standard HTTP API with just one configuration file. In addition to automated Docker images and HTTP services, Cog takes care of CUDA/cuDNN/PyTorch/Tensorflow/Python version compatibility so users don’t have to worry about setting up different versions correctly.