On Docker Desktop, open Settings, go to AI, and enable Docker Model Runner. If you are on Windows with a supported NVIDIA GPU ...
Vast.ai host machines cache commonly-used Docker image layers. By building on top of large, popular base images like nvidia/cuda and rocm/dev-ubuntu, most of the image content is already present on ...