shubhamsaboo/rag-anything

Python

20 environment variables found in env.example

Set these on your host before deploying. Each platform has an “Environment Variables” section in the deploy flow. (showing first 20, more exist in env.example)

HOST Server Configuration
PORT
WEBUI_TITLE
WEBUI_DESCRIPTION
OLLAMA_EMULATING_MODEL_TAG
SUMMARY_LANGUAGE Entity and ralation summarization configuration Language: English, Chinese, French, German ...
ENABLE_LLM_CACHE LLM Configuration
ENABLE_LLM_CACHE_FOR_EXTRACT
TIMEOUT Time out in seconds for LLM, None for infinite timeout
TEMPERATURE Some models like o1-mini require temperature to be set to 1
MAX_ASYNC Max concurrency requests of LLM
MAX_TOKENS secret MAX_TOKENS: max tokens send to LLM for entity relation summaries (less than context size of the model) MAX_TOKENS: set as num_ctx option…
LLM_BINDING LLM Binding type: openai, ollama, lollms, azure_openai, lmstudio
LLM_MODEL
LLM_BINDING_HOST
LLM_BINDING_API_KEY secret
EMBEDDING_BINDING Embedding Configuration Embedding Binding type: openai, ollama, lollms, azure_openai, lmstudio
EMBEDDING_MODEL
EMBEDDING_DIM
EMBEDDING_BINDING_API_KEY secret

Best match Fly.io Anything Dockerized — requires the Fly CLI.

macOS

brew install flyctl && fly launch --from https://github.com/shubhamsaboo/rag-anything

Linux

curl -L https://fly.io/install.sh | sh && fly launch --from https://github.com/shubhamsaboo/rag-anything

Windows (PowerShell)

iwr https://fly.io/install.ps1 -useb | iex; fly launch --from https://github.com/shubhamsaboo/rag-anything

Alternative Deploy on Railway Apps that need Postgres, Redis, or background workers.

Or deploy to a different host

Render Full-stack with managed Postgres + Redis. DigitalOcean App Platform Containers, droplets, and managed services.

← Try another repo