GitDeployHub

jlowin/litellm

github.com/jlowin/litellm ↗

By using gitdeployhub.com, you agree to our Terms and Privacy. Each deploy host has its own terms; clicking a deploy button takes you to that host’s flow.

Python
13 environment variables found in .env.example

Set these on your host before deploying. Each platform has an “Environment Variables” section in the deploy flow.

  • OPENAI_API_KEY secret OpenAI
  • OPENAI_API_BASE secret
  • COHERE_API_KEY secret Cohere
  • OR_SITE_URL OpenRouter
  • OR_APP_NAME
  • OR_API_KEY secret
  • AZURE_API_BASE secret Azure API base URL
  • AZURE_API_VERSION secret Azure API version
  • AZURE_API_KEY secret Azure API key
  • REPLICATE_API_KEY secret Replicate
  • REPLICATE_API_TOKEN secret
  • ANTHROPIC_API_KEY secret Anthropic
  • INFISICAL_TOKEN secret Infisical
Best match Fly.io Anything Dockerized — requires the Fly CLI.
macOS 
brew install flyctl && fly launch --from https://github.com/jlowin/litellm
Linux 
curl -L https://fly.io/install.sh | sh && fly launch --from https://github.com/jlowin/litellm
Windows (PowerShell) 
iwr https://fly.io/install.ps1 -useb | iex; fly launch --from https://github.com/jlowin/litellm
Alternative Deploy on Railway Apps that need Postgres, Redis, or background workers.
Or deploy to a different host
Render Full-stack with managed Postgres + Redis. DigitalOcean App Platform Containers, droplets, and managed services.
← Try another repo