GitDeployHub

mitsuhiko/pi-llamacpp

github.com/mitsuhiko/pi-llamacpp ↗

By using gitdeployhub.com, you agree to our Terms and Privacy. Each deploy host has its own terms; clicking a deploy button takes you to that host’s flow.

Node.js API
20 environment variables found in process.env references (scan)

Set these on your host before deploying. Each platform has an “Environment Variables” section in the deploy flow. (showing first 20, more exist in process.env references (scan))

  • LLAMACPP_API_KEY secret
  • LLAMACPP_CTX_SIZE
  • LLAMACPP_HOST
  • LLAMACPP_MAX_TOKENS secret
  • LLAMACPP_PORT
  • LLAMACPP_QWEN_27B_REPO
  • LLAMACPP_QWEN_27B_REVISION
  • LLAMACPP_QWEN_35B_A3B_REPO
  • LLAMACPP_QWEN_35B_A3B_REVISION
  • LLAMACPP_QWEN_REPO
  • LLAMACPP_QWEN_REVISION
  • LLAMACPP_READY_TIMEOUT_MS
  • LLAMACPP_RELEASE_ASSET_NAME
  • LLAMACPP_RELEASE_ASSET_URL
  • LLAMACPP_RELEASE_REPO
  • LLAMACPP_RELEASE_TAG
  • LLAMACPP_RUNTIME_KIND
  • LLAMACPP_SOURCE_REF
  • LLAMACPP_SOURCE_REPO
  • LLAMACPP_WATCHDOG_SCRIPT
Best match Deploy on Railway Apps that need Postgres, Redis, or background workers.
Alternative Fly.io Anything Dockerized — requires the Fly CLI.
macOS 
brew install flyctl && fly launch --from https://github.com/mitsuhiko/pi-llamacpp
Linux 
curl -L https://fly.io/install.sh | sh && fly launch --from https://github.com/mitsuhiko/pi-llamacpp
Windows (PowerShell) 
iwr https://fly.io/install.ps1 -useb | iex; fly launch --from https://github.com/mitsuhiko/pi-llamacpp
Or deploy to a different host
Render Full-stack with managed Postgres + Redis. DigitalOcean App Platform Containers, droplets, and managed services.
← Try another repo