Skip to content

Commit 512d19d

Browse files
committed
feat(consumoor): add snapshot/fuzz tests, fix Slot double-append bug, staging test infra
Add comprehensive test suite for all 77 flattener routes: - TestSnapshotCorrectness: synthetic proto events with exact column value assertions for every route, completeness enforcement requiring non-empty checks for each fixture - FuzzFlattenColumnAlignment: random proto bytes verify no panics and column alignment across all routes - FuzzFlattenNilSafety: partially-constructed events verify nil-safety - Extended TestConditionalRoutingPredicates to cover all 5 predicate routes - Extended TestValidatorsFanout to cover all 3 fan-out routes Fix canonical_beacon_block Slot column double-append: both appendPayload and appendAdditionalData were appending to b.Slot when additional data had Slot.Number set, breaking column alignment. Refactor staging correctness test infrastructure: replace smoke-test script with staging-correctness-test.sh and staging-topic-survey.sh, add docker compose staging overlay.
1 parent fdc9958 commit 512d19d

22 files changed

Lines changed: 3528 additions & 1175 deletions

.gitignore

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -18,3 +18,4 @@ sage.yaml
1818
relay-monitor.yaml
1919
cities1000.txt
2020
countries.txt
21+
deploy/local/docker-compose/xatu-consumoor-staging.yaml
Lines changed: 54 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,54 @@
1+
# Staging overlay: disables local Kafka, Vector, and non-essential services.
2+
# Consumoor connects to staging Kafka via host.docker.internal (port-forwarded).
3+
#
4+
# Usage:
5+
# docker compose -f docker-compose.yml -f deploy/local/docker-compose/docker-compose.staging.yml up -d
6+
#
7+
# See deploy/local/docker-compose/staging-correctness-test.sh for the full workflow.
8+
9+
services:
10+
# --- Disabled services (not needed for staging correctness test) ---
11+
xatu-kafka:
12+
profiles: ["disabled"]
13+
xatu-kafka-storage-format:
14+
profiles: ["disabled"]
15+
xatu-init-kafka:
16+
profiles: ["disabled"]
17+
xatu-server:
18+
profiles: ["disabled"]
19+
xatu-postgres:
20+
profiles: ["disabled"]
21+
xatu-postgres-migrator:
22+
profiles: ["disabled"]
23+
xatu-vector-http-kafka:
24+
profiles: ["disabled"]
25+
xatu-vector-kafka-clickhouse:
26+
profiles: ["disabled"]
27+
xatu-vector-kafka-clickhouse-libp2p:
28+
profiles: ["disabled"]
29+
xatu-sentry-logs:
30+
profiles: ["disabled"]
31+
xatu-cannon:
32+
profiles: ["disabled"]
33+
xatu-nginx:
34+
profiles: ["disabled"]
35+
xatu-grafana:
36+
profiles: ["disabled"]
37+
xatu-prometheus:
38+
profiles: ["disabled"]
39+
tempo:
40+
profiles: ["disabled"]
41+
tempo-init:
42+
profiles: ["disabled"]
43+
44+
# --- Override consumoor to use staging Kafka ---
45+
xatu-consumoor:
46+
volumes:
47+
- ./deploy/local/docker-compose/xatu-consumoor-staging.yaml:/etc/consumoor/config.yaml
48+
extra_hosts:
49+
- "host.docker.internal:host-gateway"
50+
depends_on:
51+
xatu-clickhouse-01:
52+
condition: service_healthy
53+
xatu-clickhouse-consumoor-init:
54+
condition: service_completed_successfully

deploy/local/docker-compose/smoke-test-correctness.sh

Lines changed: 0 additions & 194 deletions
This file was deleted.

0 commit comments

Comments
 (0)