docker/genai-stack

Python

3 environment variables found in env.example

Set these on your host before deploying. Each platform has an “Environment Variables” section in the deploy flow.

LLM LLM and Embedding Model
EMBEDDING_MODEL
GOOGLE_API_KEY secret GOOGLE Only required when using GoogleGenai LLM or embedding model

Best match Fly.io Anything Dockerized — requires the Fly CLI.

macOS

brew install flyctl && fly launch --from https://github.com/docker/genai-stack

Linux

curl -L https://fly.io/install.sh | sh && fly launch --from https://github.com/docker/genai-stack

Windows (PowerShell)

iwr https://fly.io/install.ps1 -useb | iex; fly launch --from https://github.com/docker/genai-stack

Or deploy to a different host