GitDeployHub

codecentric/llm-eval

github.com/codecentric/llm-eval ↗
Unknown stack
18 environment variables found in .env.example

Set these on your host before deploying. Each platform has an “Environment Variables” section in the deploy flow.

  • AUTH_SECRET secret keys
  • LLM_EVAL_ENCRYPTION_KEY secret
  • AUTH_JWT_SECRET secret
  • AUTH_ALGORITHMS
  • RAGAS_PARALLEL_GENERATION_LIMIT backend application settings
  • DEEPEVAL_MAX_RETRIES
  • EVALUATION_MAX_RETRIES
  • EVALUATION_RUN_ASYNC
  • EVALUATION_SHOW_INDICATOR
  • EVALUATION_PARALLEL_TEST_CASES
  • AZURE_OPENAI_ENDPOINT secret required for catalog generation
  • AZURE_OPENAI_API_KEY secret
  • AZURE_OPENAI_API_VERSION secret
  • AZURE_OPENAI_EMBEDDING_DEPLOYMENT secret
  • AZURE_OPENAI_CHAT_DEPLOYMENT secret only for cli relevant
  • KEYCLOAK_BASE_URL change if you are using external services
  • CELERY_BROKER_HOST
  • PG_HOST
Best match Fly.io Anything Dockerized — requires the Fly CLI.
macOS
brew install flyctl && fly launch --from https://github.com/codecentric/llm-eval
Linux
curl -L https://fly.io/install.sh | sh && fly launch --from https://github.com/codecentric/llm-eval
Windows (PowerShell)
iwr https://fly.io/install.ps1 -useb | iex; fly launch --from https://github.com/codecentric/llm-eval
Or deploy to a different host
← Try another repo