Skip to content

feat(eval): retrieval quality harness (recall@k / nDCG / MRR) + product audit #1018

feat(eval): retrieval quality harness (recall@k / nDCG / MRR) + product audit

feat(eval): retrieval quality harness (recall@k / nDCG / MRR) + product audit #1018

Triggered via pull request July 22, 2026 14:30
Status Failure
Total duration 6m 23s
Artifacts 2

ci.yml

on: pull_request
golangci-lint
1m 8s
golangci-lint
Go build, vet & test + coverage
2m 22s
Go build, vet & test + coverage
Bug hunt tag check (PR)
7s
Bug hunt tag check (PR)
Security scan (govulncheck)
25s
Security scan (govulncheck)
Trivy image scan (API + Worker)
1m 53s
Trivy image scan (API + Worker)
Helm chart lint
11s
Helm chart lint
Massive / realistic workload tests
21s
Massive / realistic workload tests
Massive workload via HTTP (docker compose)
1m 58s
Massive workload via HTTP (docker compose)
Integration E2E (docker compose + OpenAI)
3m 51s
Integration E2E (docker compose + OpenAI)
Retrieval quality eval (recall@k / nDCG)
2m 47s
Retrieval quality eval (recall@k / nDCG)
Integration graph (complete AGE matrix)
1m 32s
Integration graph (complete AGE matrix)
Bug hunt (daily)
0s
Bug hunt (daily)
Integration smoke (Postgres + Redis)
0s
Integration smoke (Postgres + Redis)
Fit to window
Zoom out
Zoom in

Annotations

15 errors
Security scan (govulncheck)
Process completed with exit code 1.
Security scan (govulncheck)
migrate.main calls pgxpool.New, which eventually calls norm.Form.Transform
Security scan (govulncheck)
model.NormalizeContentForHash calls norm.Form.String
Security scan (govulncheck)
migrate.main calls pgxpool.New, which eventually calls norm.Form.Span
Security scan (govulncheck)
migrate.main calls pgxpool.New, which eventually calls norm.Form.Properties
golangci-lint: internal/model/pagination.go#L65
error: Potential nil panic detected. Observed nil flow from source to dereference point:
golangci-lint
function parameter `items` sliced into
golangci-lint
unassigned variable `entries` passed as arg `items` to `FinishInt64Page()`
golangci-lint: internal/model/pagination.go#L65
error: Potential nil panic detected. Observed nil flow from source to dereference point:
golangci-lint
function parameter `items` sliced into
golangci-lint
unassigned variable `scanned` passed as arg `items` to `FinishInt64Page()`
golangci-lint: internal/model/pagination.go#L65
error: Potential nil panic detected. Observed nil flow from source to dereference point:
golangci-lint
function parameter `items` sliced into
golangci-lint
unassigned variable `out` passed as arg `items` to `FinishInt64Page()`
golangci-lint: internal/model/pagination.go#L65
error: Potential nil panic detected. Observed nil flow from source to dereference point:

Artifacts

Produced during runtime
Name Size Digest
coverage-29928954903 Expired
53.2 KB
sha256:91899d3db9dc32b3aee2842d6c441671cebe138c5a9bce801e41a33f696e0d90
retrieval-eval-report-29928954903 Expired
1.01 KB
sha256:0d6a7d9a444e761f61ae6d3e7cb0bf700cdd8835e68f93d7bfb0f48e2246bac1