Repository navigation

Rework Strict review for the official model: deep passes, per-comment verification, self-proving evidence - #71

Merged

tzhouam merged 55 commits into

mainfrom

rfc/strict-review-deep-engine

Aug 19, 2026

Merged

Rework Strict review for the official model: deep passes, per-comment verification, self-proving evidence#71
tzhouam merged 55 commits into
mainfrom
rfc/strict-review-deep-engine

Commits on Aug 14, 2026
- Rework Strict review for the official model: deep passes, per-comment verification, self-proving evidence
  
  tzhouam
  and
  claude
  committed
  b32f114
- Eval harness: pipelined gen+judge orchestrator, cursor-agent harness arm, wave-2 holdout wiring
  
  tzhouam
  and
  claude
  committed
  81e4b6f
- Eval data: wave-2 holdout arms, judgments, and consolidated model-comparison results
  
  tzhouam
  and
  claude
  committed
  b3a0f07
- MoA harness members: mixture members may ride a provider-registry harness
  
  tzhouam
  and
  claude
  committed
  31701ae
- Audit: resolve relative tool paths against the session cwd
  
  tzhouam
  and
  claude
  committed
  25f4ccb
- Cursor-backend eval campaign: composer/grok arms, MoA replicate, consolidated results
  
  tzhouam
  and
  claude
  committed
  a9e650b
- Results: normalized view — each arm ÷ its in-matchup baseline
  
  tzhouam
  and
  claude
  committed
  3c9305f
- Results: fix two stale hand-written rows, stamp table INTERIM
  
  tzhouam
  and
  claude
  committed
  3047242
Commits on Aug 15, 2026
- Strict review v14/v15: distilled duties, docs pass, second round, archaeology tools
  
  tzhouam
  and
  claude
  committed
  4c0986b
- Eval: waves 3-4 frozen holdouts + holdout3/holdout4 harness wiring
  
  tzhouam
  and
  claude
  committed
  bbf162a
- Eval data: v14/v15 campaign arms, judgments, wave-3/4 baselines, results
  
  tzhouam
  and
  claude
  committed
  1d28450
- Cheap-seats model routing + per-pass backend role-split
  
  tzhouam
  and
  claude
  committed
  893d745
- Providers: integrate M2/M3 backends (claude-code, codex) from PR #82
  
  tzhouam
  and
  claude
  committed
  d5d6193
- Eval data: wave-4 v15 replicate 2, role-split + v16 probes, v16 gate
  
  tzhouam
  and
  claude
  committed
  e3cdc17
- Paired item-clustered statistics; wave-5 draw + pre-registration
  
  tzhouam
  and
  claude
  committed
  36cbec5
- Campaign report v14-v16 + document the two supported review configs
  
  tzhouam
  and
  claude
  committed
  0aa5229
Commits on Aug 16, 2026
- Wave-5 pre-registered measurement: the recall deficit is real (-.049)
  
  tzhouam
  and
  claude
  committed
  22e100b
- Routed seats: preserve routing on retry, fall back loudly, gate the arm
  
  tzhouam
  and
  claude
  committed
  f55aa55
- Conversion fixes: the reasoning existed, the routing lost it
  
  tzhouam
  and
  claude
  committed
  ae1b6f1
- Pre-register the v17 conversion-fix probe before generating it
  
  tzhouam
  and
  claude
  committed
  f9383d0
- Probe: disclose smoke reuse and the dedupe defect left unfixed on purpose
  
  tzhouam
  and
  claude
  committed
  11e9318
- v17 conversion-fix probe: the fixes did not close the recall gap (-.050)
  
  tzhouam
  and
  claude
  committed
  b718c9b
Commits on Aug 17, 2026
- Amend the v17 probe: the first run was an unintended vendor mixture
  
  tzhouam
  and
  claude
  committed
  17f549c
- Relabel the first v17 run as v17-moa in the data and the results table
  
  tzhouam
  and
  claude
  committed
  cabee89
- Correct the MoA contamination magnitude: ~10%, not 24%
  
  tzhouam
  and
  claude
  committed
  4725020
- Corrected v17ds run halted: DeepSeek 402 Insufficient Balance at 7/15 items
  
  tzhouam
  and
  claude
  committed
  ebf075e
- v17 val, both backends: Composer 2.5 reaches recall parity where DeepSeek does not
  
  tzhouam
  and
  claude
  committed
  3fb41b8
- Corrected v17 probe completes: parity on spent splits; yesterday's conclusion withdrawn
  
  tzhouam
  and
  claude
  committed
  a7ccbbf
- DeepSeek Harness (dsh) provider: the fourth backend, and the first API-keyed one
  
  tzhouam
  and
  claude
  committed
  17b5e15
- Composer 2.5 on v17 train: the api/DeepSeek core is the champion
  
  tzhouam
  and
  claude
  committed
  8ba5e95
- Render defects the pr4893 forensics found, plus dsh on native tools
  
  tzhouam
  and
  claude
  committed
  c89b6a7
- Three eval-process gates, one per incident that cost a measurement today
  
  tzhouam
  and
  claude
  committed
  e2cfcaf
- dsh: bound the session ourselves -- the harness has no step cap
  
  tzhouam
  and
  claude
  committed
  dd97643
- Three doc linters, because nothing checked documentation at all
  
  tzhouam
  and
  claude
  committed
  cff2d4f
- Two false capability claims the SPEC rewrite caught
  
  tzhouam
  and
  claude
  committed
  8fee3d3
- Refactor doc/ into a signposted tree, and fix what the move broke
  tzhouam
  committed
  9647b1b
- Wire the doc gates into CI, blocking
  
  tzhouam
  and
  claude
  committed
  31e5c72
- v19 signal density: the ledger dedupe was inert, and it cost Composer most
  
  tzhouam
  and
  claude
  committed
  fe35baf
- Collapse path identifiers to basenames when scoring shared subjects
  
  tzhouam
  and
  claude
  committed
  7bbb35b
- v20: merge duplicate findings to their richest statement instead of dropping
  
  tzhouam
  and
  claude
  committed
  4c8d67e
- v21: give each finding a claim headline and its evidence a quote block
  
  tzhouam
  and
  claude
  committed
  c5c5697
Commits on Aug 18, 2026
- v21 fix: emit a headline only when there IS a claim and an argument
  
  tzhouam
  and
  claude
  committed
  fb54f94
- Revert v21: the finding-headline restructure measurably costs recall
  
  tzhouam
  and
  claude
  committed
  59579ed
- v22: require the causal mechanism in a finding, not just the flag
  
  tzhouam
  and
  claude
  committed
  82d682f
- Revert v22: requiring per-finding mechanism depth costs recall
  
  tzhouam
  and
  claude
  committed
  1e40b25
- v23: add a breadth sweep lens to the round-1 ensemble
  
  tzhouam
  and
  claude
  committed
  7d4055d
- Revert v23 sweep lens: coverage rose, recall did not
  
  tzhouam
  and
  claude
  committed
  4e3b324
Commits on Aug 19, 2026
- Correct the pr4970 figures in 4e3b324, and record leave-one-out
  
  tzhouam
  and
  claude
  committed
  89e915f
- Carry forward the PR #71 RFC from the remote branch, with its rollout claim corrected
  
  tzhouam
  and
  claude
  committed
  17b77c3
- Fix the CI breakage from the knowledge/ to doc/knowledge/ move
  
  tzhouam
  and
  claude
  committed
  d7cd6b9
- Add the vs-Opus-5 performance chart used in the PR description
  
  tzhouam
  and
  claude
  committed
  e12f5fc
- Land the in-flight doc/knowledge refactor for the authoring pages
  
  tzhouam
  and
  claude
  committed
  2449ac1
- Point the doc-link checker at the moved templates tree, and finish CLAUDE.md
  
  tzhouam
  and
  claude
  committed
  d228b0a
- Land the rest of the doc/ refactor so the tree is self-consistent
  
  tzhouam
  and
  claude
  committed
  6f66ed2
- Give CI full git history so the SPEC freshness check can work
  
  tzhouam
  and
  claude
  committed
  91919a5

Commits

Commits on Aug 14, 2026

Commits on Aug 15, 2026

Commits on Aug 16, 2026

Commits on Aug 17, 2026

Commits on Aug 18, 2026

Commits on Aug 19, 2026