GitDeployHub

BerriAI/litellm

github.com/BerriAI/litellm ↗

By using gitdeployhub.com, you agree to our Terms and Privacy. Each deploy host has its own terms; clicking a deploy button takes you to that host’s flow.

Python
18 environment variables found in .env.example

Set these on your host before deploying. Each platform has an “Environment Variables” section in the deploy flow.

  • OPENAI_API_KEY secret OpenAI
  • OPENAI_BASE_URL secret
  • COHERE_API_KEY secret Cohere
  • OR_SITE_URL OpenRouter
  • OR_APP_NAME
  • OR_API_KEY secret
  • AZURE_API_BASE secret Azure API base URL
  • AZURE_API_VERSION secret Azure API version
  • AZURE_API_KEY secret Azure API key
  • REPLICATE_API_KEY secret Replicate
  • REPLICATE_API_TOKEN secret
  • ANTHROPIC_API_KEY secret Anthropic
  • INFISICAL_TOKEN secret Infisical
  • NOVITA_API_KEY secret Novita AI
  • INFINITY_API_KEY secret
  • LITELLM_MASTER_KEY secret Development Configs
  • DATABASE_URL secret
  • STORE_MODEL_IN_DB
Best match Fly.io Anything Dockerized — requires the Fly CLI.
macOS 
brew install flyctl && fly launch --from https://github.com/BerriAI/litellm
Linux 
curl -L https://fly.io/install.sh | sh && fly launch --from https://github.com/BerriAI/litellm
Windows (PowerShell) 
iwr https://fly.io/install.ps1 -useb | iex; fly launch --from https://github.com/BerriAI/litellm
Alternative Deploy on Railway Apps that need Postgres, Redis, or background workers.
Or deploy to a different host
Render Full-stack with managed Postgres + Redis. DigitalOcean App Platform Containers, droplets, and managed services.
← Try another repo