-
-
Notifications
You must be signed in to change notification settings - Fork 23
Home
AI-Dock is an effort to containerise popular GPU-based AI & Machine Learning applications for use in the cloud. The goal is to enable users who may not be able to afford the hardware required to run such applications to avoid being 'left behind' as technology advances.
The preferred target environments are container-first cloud providers where it may not be possible to run more than one container per GPU. These providers are commonly less expensive than traditional cloud services but the trade-off is that it's necessary to bundle several applications inside a single container image.
While this approach may not fit well with the Docker principle of 'one container per process', it is perfectly reasonable given the nature of our target platforms.
AI-Dock containers are primarily built for use at Vast.ai which is a large open marketplace for GPU enabled hardware. Containers are also tested for compatibility with RunPod.io.
Runtime templates will be made available for these platforms and linked from within the respective container.
Containers will also run locally and on standard cloud platforms, but support will be limited for this use case.
All AI-Dock containers extend this (base-image) container so many of the configurable options will be the same regardless of which bundled application you are running. Those shared options will be documented in this wiki. Options which are specific to the bundled application(s) will be documented in the wiki for that particular container.