Skip to content

Commit f0f2cdc

Browse files
Bump Redis maxmemory 512mb→1gb + mem_limit 768m→1.5g (#2532)
1 parent bb577e5 commit f0f2cdc

2 files changed

Lines changed: 8 additions & 7 deletions

File tree

apps/crawler/AGENTS.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -511,7 +511,7 @@ ssh ... 'cd /home/deploy/crawler-src && docker build --target full -t crawler-fu
511511
| exporter | crawler-slim | 9093 | — | — |
512512
| drain | crawler-slim | 9094 | — | — |
513513
| alloy | grafana/alloy | 12346 | 0.25 | 256MB |
514-
| redis | redis:7-alpine | — | — | 320MB |
514+
| redis | redis:7-alpine | — | — | 1.5GB (1GB maxmemory) |
515515
516516
### Querying Metrics
517517

apps/crawler/docker-compose.yml

Lines changed: 7 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -32,14 +32,15 @@ services:
3232
image: redis:7-alpine
3333
restart: unless-stopped
3434
network_mode: host
35-
# Deploy-time sync reseeds ~4.7k board monitors into Redis. 256 MB
36-
# leaves too little headroom once steady-state scrape backlog is
37-
# already present, so deploys can fail with OOM before sync
38-
# completes.
39-
command: redis-server --maxmemory 512mb --maxmemory-policy noeviction --bind 127.0.0.1
35+
# Sized for the steady-state scrape backlog, not the initial reseed.
36+
# ~550k keys at 2026-04-23 used ~373 MB (73% of the old 512 MB cap),
37+
# nearly triggering noeviction-stalled writes. 1 GB gives headroom
38+
# while the pipeline drains stale per-domain queues (#2526) and the
39+
# SuccessFactors URL-canonicalization fix (#2524) cuts cardinality.
40+
command: redis-server --maxmemory 1gb --maxmemory-policy noeviction --bind 127.0.0.1
4041
volumes:
4142
- redis-data:/data
42-
mem_limit: 768m
43+
mem_limit: 1536m
4344
healthcheck:
4445
test: ["CMD", "redis-cli", "ping"]
4546
interval: 10s

0 commit comments

Comments
 (0)