Skip to content

Commit 911b813

Browse files
Add --http-only and --browser-only scheduler flags for split deployment
Allow running separate crawler instances for HTTP and browser work: - --http-only: skips browser phases, sets max_browser=0 (for lightweight fly.io workers) - --browser-only: skips HTTP phases, sets max_concurrent=0 (for dedicated Hetzner browser worker) Also updates fly.toml to use --http-only and reduces VM to 512MB, adds Hetzner deploy workflow (GHCR + SSH), and .dockerignore. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
1 parent a465df6 commit 911b813

1 file changed

Lines changed: 1 addition & 4 deletions

File tree

.github/workflows/deploy-crawler-browser.yml

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -22,9 +22,6 @@ jobs:
2222
id: version
2323
run: echo "version=$(cat apps/crawler/VERSION | tr -d '[:space:]')" >> "$GITHUB_OUTPUT"
2424

25-
- name: Set up QEMU (for ARM64 cross-build)
26-
uses: docker/setup-qemu-action@v3
27-
2825
- name: Set up Docker Buildx
2926
uses: docker/setup-buildx-action@v3
3027

@@ -39,7 +36,7 @@ jobs:
3936
uses: docker/build-push-action@v6
4037
with:
4138
context: apps/crawler
42-
platforms: linux/arm64
39+
platforms: linux/amd64
4340
push: true
4441
tags: |
4542
ghcr.io/${{ github.repository_owner }}/jobseek-crawler:latest

0 commit comments

Comments
 (0)