GitDeployHub

3dluvr/vllm-int8-kv-cache-for-ampere-sm86

github.com/3dluvr/vllm-int8-kv-cache-for-ampere-sm86 ↗
Unknown stack
Best match Fly.io Anything Dockerized — requires the Fly CLI.
macOS
brew install flyctl && fly launch --from https://github.com/3dluvr/vllm-int8-kv-cache-for-ampere-sm86
Linux
curl -L https://fly.io/install.sh | sh && fly launch --from https://github.com/3dluvr/vllm-int8-kv-cache-for-ampere-sm86
Windows (PowerShell)
iwr https://fly.io/install.ps1 -useb | iex; fly launch --from https://github.com/3dluvr/vllm-int8-kv-cache-for-ampere-sm86
Or deploy to a different host
← Try another repo