Example validation report: customer-support triage local no-network run

[hkalbertkim]

This is an example validation report format for KORA local no-network validation.

It uses the synthetic customer-support triage workload and the local validation adapter. No API keys, external providers, private data, or network calls are required.

Validation mode

Local no-network validation

Workload

Synthetic customer-support triage

Related workload spec:

https://github.com/Krako-Labs/KORA/blob/main/docs/workloads/customer-support-triage.md

Command

python3 -m kora run customer_support_triage_fake_validation -- --offline --report-md /tmp/kora_customer_support_validation.md

Expected summary

Counter	Expected value
total_requests	12
baseline_model_calls	12
kora_model_calls	4
avoided_model_calls	8
avoided_model_call_rate	0.6667
deterministic_routes	8
model_escalations	4

Interpretation

In this synthetic workload, the direct baseline sends every request to the model-call path.

KORA-controlled execution routes deterministic requests through structured paths and escalates only model-required requests.

This produces:

• 12 baseline model-call events
• 4 KORA-controlled model-call events
• 8 avoided model-call events
• 66.67% avoided model-call event rate

What this shows

This shows that KORA can measure avoided model-call events in a synthetic, local no-network validation workload.

What this does not show

This does not prove:

• production cost reduction
• real API-cost reduction
• production validation
• energy reduction
• broad workload superiority
• real provider validation

Privacy and artifact handling

This example uses synthetic data only.

Do not post:

• API keys
• secrets
• private customer data
• raw provider responses
• proprietary datasets
• production logs

Related docs

• Local validation reviewer packet: https://github.com/Krako-Labs/KORA/blob/main/docs/benchmarks/local-validation-reviewer-packet.md
• Real model-call validation design: https://github.com/Krako-Labs/KORA/blob/main/docs/benchmarks/real-model-call-validation-design.md
• Report template: https://github.com/Krako-Labs/KORA/blob/main/docs/benchmarks/real-model-call-validation-report-template.md