.env.example
Set these on your host before deploying. Each platform has an “Environment Variables” section in the deploy flow. (showing first 20, more exist in .env.example)
PROJECT_NAME
Basic
LOG_LEVEL
MODEL_BACKEND_MODE
REAL_BACKEND_BASE_URL
Optional: route display remains device/edge/cloud, but all tiers call one real OpenAI-compatible backend for demos.
REAL_BACKEND_API_KEY
secret
REAL_BACKEND_MODEL
DEVICE_BACKEND_MODEL
EDGE_BACKEND_MODEL
CLOUD_BACKEND_MODEL
LITELLM_MASTER_KEY
secret
LiteLLM / gateway
LITELLM_PORT
OLLAMA_HOST
Device: Ollama
OLLAMA_DEVICE_MODEL
ROUTELLM_CACHE_DIR
Classifier
ROUTELLM_ROUTER
ROUTELLM_STRONG_MODEL
ROUTELLM_WEAK_MODEL
ROUTELLM_MF_CHECKPOINT
ROUTELLM_LOCAL_EMBEDDINGS
ROUTELLM_TEXT_DIM
brew install flyctl && fly launch --from https://github.com/adongwanai/hybrid-router-oss
curl -L https://fly.io/install.sh | sh && fly launch --from https://github.com/adongwanai/hybrid-router-oss
iwr https://fly.io/install.ps1 -useb | iex; fly launch --from https://github.com/adongwanai/hybrid-router-oss