Skip to content

fix: clarify run detail result metrics - #5

Merged
pppolf merged 10 commits into
mainfrom
codex/complete-evaluation-workflow
Oct 26, 2026
Merged

pppolf merged 10 commits into
mainfrom
codex/complete-evaluation-workflow

Conversation

@pppolf

@pppolf pppolf commented Aug 30, 2026

Copy link
Copy Markdown
Member

Summary

  • distinguish unscored answers, ordinary wrong answers, and execution errors in Run Detail
  • expose Run-wide known input/output token subtotals and independent coverage on the paginated Responses API
  • preserve protocol-v1 exact-token null semantics while showing explicitly incomplete evidence

Validation

  • make lint
  • make test (backend 951 passed, 33 skipped; frontend 47 passed)
  • make smoke
  • frontend production build
  • docker compose config --quiet
  • target Run verified through the local API and browser UI

No real Provider was called and no historical data or schema was modified.

@pppolf
pppolf merged commit 742a1ab into main Oct 26, 2026
4 checks passed
@pppolf
pppolf deleted the codex/complete-evaluation-workflow branch October 26, 2026 06:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant