GitDeployHub

berriai/litellm-proxy

github.com/berriai/litellm-proxy ↗

By using gitdeployhub.com, you agree to our Terms and Privacy. Each deploy host has its own terms; clicking a deploy button takes you to that host’s flow.

Python
14 environment variables found in .env.template

Set these on your host before deploying. Each platform has an “Environment Variables” section in the deploy flow.

  • OPENAI_API_KEY secret
  • ANTHROPIC_API_KEY secret
  • REPLICATE_API_KEY secret
  • COHERE_API_KEY secret
  • HUGGINGFACE_API_KEY secret
  • TOGETHERAI_API_KEY secret
  • BASETEN_API_KEY secret
  • AI21_API_KEY secret
  • OPENROUTER_API_KEY secret
  • ALEPH_ALPHA_API_KEY secret
  • AZURE_API_BASE secret
  • AZURE_API_VERSION secret
  • AZURE_API_KEY secret
  • DEFAULT_MODEL
Best match Fly.io Anything Dockerized — requires the Fly CLI.
macOS 
brew install flyctl && fly launch --from https://github.com/berriai/litellm-proxy
Linux 
curl -L https://fly.io/install.sh | sh && fly launch --from https://github.com/berriai/litellm-proxy
Windows (PowerShell) 
iwr https://fly.io/install.ps1 -useb | iex; fly launch --from https://github.com/berriai/litellm-proxy
Alternative Deploy on Railway Apps that need Postgres, Redis, or background workers.
Or deploy to a different host
Render Full-stack with managed Postgres + Redis. DigitalOcean App Platform Containers, droplets, and managed services.
← Try another repo