GitDeployHub

dontriskit/firecrawl

github.com/dontriskit/firecrawl ↗
Unknown stack
20 environment variables found in apps/api/.env.example

Set these on your host before deploying. Each platform has an “Environment Variables” section in the deploy flow. (showing first 20, more exist in apps/api/.env.example)

  • NUM_WORKERS_PER_QUEUE Required ENVS
  • PORT
  • HOST
  • REDIS_URL secret
  • REDIS_RATE_LIMIT_URL
  • PLAYWRIGHT_MICROSERVICE_URL
  • USE_DB_AUTHENTICATION To turn on DB authentication, you need to set up supabase.
  • SEARCHAPI_API_KEY secret SearchApi key. Head to https://searchapi.com/ to get your API key
  • SEARCHAPI_ENGINE SearchApi engine, defaults to google. Available options: google, bing, baidu, google_news, etc. Head to https://searchapi.com/ to explore…
  • SUPABASE_ANON_TOKEN secret Supabase Setup (used to support DB authentication, advanced logging, etc.)
  • SUPABASE_URL
  • SUPABASE_SERVICE_TOKEN secret
  • TEST_API_KEY secret Other Optionals use if you've set up authentication and want to test with a real API key
  • RATE_LIMIT_TEST_API_KEY_SCRAPE secret set if you'd like to test the scraping rate limit
  • RATE_LIMIT_TEST_API_KEY_CRAWL secret set if you'd like to test the crawling rate limit
  • SCRAPING_BEE_API_KEY secret set if you'd like to use scraping Be to handle JS blocking
  • OPENAI_API_KEY secret add for LLM dependednt features (image alt generation, etc.)
  • BULL_AUTH_KEY secret
  • LLAMAPARSE_API_KEY secret set if you have a llamaparse key you'd like to use to parse pdfs
  • SLACK_WEBHOOK_URL set if you'd like to send slack server health status messages
Best match Fly.io Anything Dockerized — requires the Fly CLI.
macOS
brew install flyctl && fly launch --from https://github.com/dontriskit/firecrawl
Linux
curl -L https://fly.io/install.sh | sh && fly launch --from https://github.com/dontriskit/firecrawl
Windows (PowerShell)
iwr https://fly.io/install.ps1 -useb | iex; fly launch --from https://github.com/dontriskit/firecrawl
Or deploy to a different host
← Try another repo