Skip to content

v0.22.0 — Semantic Session Diff

Choose a tag to compare

View all tags
@Siddhant-K-code Siddhant-K-code released this 11 Apr 17:48
v0.22.0
969535d

Semantic Session Diff

Ever re-run an agent on the same task and wondered what actually changed? agent-trace diff --semantic compares two sessions by outcome rather than raw event order — so you see meaningful differences like new tools used, changed error rates, or diverging token costs, not just line-by-line noise.

# Compare two runs of the same task
agent-trace diff SESSION_A SESSION_B --semantic

# Export a structured JSON report for CI or further processing
agent-trace diff SESSION_A SESSION_B --semantic --eval-config eval.json

What the report covers:

  • Tools added or removed between runs
  • Change in total tool calls, errors, and token usage
  • Whether the session outcome improved, regressed, or stayed the same
  • A plain-language summary you can paste into a PR description or eval log

This is useful for regression testing agent behaviour — run the same prompt twice (or against two model versions) and get a structured diff you can assert on in CI.

Assets 2
Loading