Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
cbf7481
Improve dashboard responsiveness, graph rendering, and draft retention
Coding-Dev-Tools Oct 12, 2026
8bcee85
Pin dashboard audit evidence to its tested source
Coding-Dev-Tools Oct 12, 2026
434b58e
Validate Ledger cache busting without pinning an obsolete asset version
Coding-Dev-Tools Oct 12, 2026
6105a96
Integrate reviewed Spec Crawl fixes with dashboard improvements
Coding-Dev-Tools Oct 12, 2026
43aaecf
Pin combined dashboard and review evidence to tested source
Coding-Dev-Tools Oct 12, 2026
08ec13c
Merge remote-tracking branch 'origin/codex/spec-crawl-readiness-20261…
Coding-Dev-Tools Oct 12, 2026
f5f2fb8
Integrate the procedural source budget guard with dashboard updates
Coding-Dev-Tools Oct 12, 2026
ea07be0
Pin dashboard budget evidence to the combined source
Coding-Dev-Tools Oct 12, 2026
d7939ea
Invalidate cancelled graph transactions before workspace refresh
Coding-Dev-Tools Oct 12, 2026
aedbf3a
Keep import polls owned by their job and repaint settled graph changes
Coding-Dev-Tools Oct 14, 2026
be72b55
Integrate scoped audit safeguards into the dashboard branch
Coding-Dev-Tools Oct 14, 2026
f4f585b
Publish fresh immutable evidence for PR #261
Coding-Dev-Tools Oct 14, 2026
f6bf7e7
Pin chart links to the verified PR evidence source
Coding-Dev-Tools Oct 14, 2026
b1a4365
Integrate the verified documentation revision contracts
Coding-Dev-Tools Oct 14, 2026
a07ca9a
Publish fresh immutable evidence for PR #261
Coding-Dev-Tools Oct 14, 2026
745e24b
Pin chart links to the verified PR evidence source
Coding-Dev-Tools Oct 14, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions BENCHMARKS.md
Original file line number Diff line number Diff line change
Expand Up @@ -94,14 +94,14 @@ interpretation and do not count as additional benchmark-quality gains.
### Public numeric evidence registry

Every exact public aggregate retained below comes from the checked-in, public-safe
[`offline-fixtures-pr260-final-20261014.json`](docs/benchmark-evidence/offline-fixtures-pr260-final-20261014.json) artifact. Its
[`offline-fixtures-pr261-git-bytes-20261014.json`](docs/benchmark-evidence/offline-fixtures-pr261-git-bytes-20261014.json) artifact. Its
SHA-256 is
`74fa8160bcdf3c0efa2e96eab3cd1f5416febdf901032179af76a5274b822031`, also recorded in the
`998a65945b85d8fb91287474389b14bb908057f1ed06d75d79260027f1bcd11d`, also recorded in the
adjacent `.sha256` file. The artifact contains no raw questions, answers, prompts, customer data,
or per-record content fingerprints.

The fixture-suite digest is
`e301d1f45ca2b41394c04b1a505a8e43c504c4e2a2aaf7556fb15c71d9cbb0d3`. The artifact defines
`cff9ddc5c861f217ca7624ab0a0e301a813147a2c49a52a7991a3e3dd532b9ea`. The artifact defines
the digest algorithm and records the SHA-256 of every suite and dataset file. Each evidence ID
also binds its exact command through `sha256(UTF-8 exact command)`:

Expand All @@ -126,13 +126,13 @@ grounded checks in separate panels; provider billing and MCP transport are not m
the SVG and matching PNG with:

```bash
python scripts/render_benchmark_report.py --report docs/benchmark-evidence/offline-fixtures-pr260-final-20261014.json --output docs/images/context-efficiency.svg --png-output docs/images/context-efficiency.png
python scripts/render_benchmark_report.py --report docs/benchmark-evidence/offline-fixtures-pr261-git-bytes-20261014.json --output docs/images/context-efficiency.svg --png-output docs/images/context-efficiency.png
```

The companion examples are also generated from that artifact with:

```bash
python -m scripts.render_benchmark_examples --report docs/benchmark-evidence/offline-fixtures-pr260-final-20261014.json --output docs/images/evidence-backed-agent-examples.svg --png-output docs/images/evidence-backed-agent-examples.png
python -m scripts.render_benchmark_examples --report docs/benchmark-evidence/offline-fixtures-pr261-git-bytes-20261014.json --output docs/images/evidence-backed-agent-examples.svg --png-output docs/images/evidence-backed-agent-examples.png
```
The historical-to-executable mapping is in
[`docs/BENCHMARK_CHANGE_COVERAGE.md`](docs/BENCHMARK_CHANGE_COVERAGE.md).
Expand Down
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@ Connect a coding agent over MCP with the [agent setup guide](https://github.com/
The current registered artifact contains three deterministic offline fixture runs. It separates context size, retrieval quality, and grounded decision checks; these small fixtures do not establish general task performance.

<p align="center">
<img src="https://raw.githubusercontent.com/Coding-Dev-Tools/engraphis/5bba9386b7600e10bcc89da3ad1f163408f181e3/docs/images/context-efficiency.svg" alt="Three registered offline fixtures: structure-aware chunking reduced mean retrieved context from 740.3 to 214.3 tokens per question (71.1%, 18 questions); the serialized JSON-shape proxy fell from 24,590 to 11,138 tokens across 26 payload samples and 260 recalls. Candidate and packed retrieval quality (Recall@5, Hit@5, and answer-token recall) are shown separately (each 1.000). Grounded checks show 5/5 answerable queries grounded and 6/6 abstention queries rejected, including a 1/1 quarantined-evidence probe; 11/11 decisions were correct. MCP transport and provider billing were not measured. Artifact SHA-256 prefix 74fa8160bcdf; see the benchmark guide for the full checksum." width="100%">
<img src="https://raw.githubusercontent.com/Coding-Dev-Tools/engraphis/a07ca9ad2d0be588b4595c2f14a7292ea4a9ac7d/docs/images/context-efficiency.svg" alt="Three registered offline fixtures: structure-aware chunking reduced mean retrieved context from 740.3 to 214.3 tokens per question (71.1%, 18 questions); the serialized JSON-shape proxy fell from 24,590 to 11,138 tokens across 26 payload samples and 260 recalls. Candidate and packed retrieval quality (Recall@5, Hit@5, and answer-token recall) are shown separately (each 1.000). Grounded checks show 5/5 answerable queries grounded and 6/6 abstention queries rejected, including a 1/1 quarantined-evidence probe; 11/11 decisions were correct. MCP transport and provider billing were not measured. Artifact SHA-256 prefix 998a65945b85; see the benchmark guide for the full checksum." width="100%">
<br>
<sup>Three offline fixtures separate context reduction, candidate and packed retrieval quality, and grounded behavior. The chart shows the artifact checksum prefix; see the benchmark guide for the full checksum and reproduction steps.</sup>
</p>
Expand All @@ -60,7 +60,7 @@ The current registered artifact contains three deterministic offline fixture run
| Recall payload proxy | JSON-shape proxy: 24,590 → 11,138 tokens (54.71% lower, 26 samples; 260 timed recalls) | Candidate and packed Recall@5, Hit@5, and answer-token recall are each 1.000 |
| Grounded decisions | 5/5 answerable queries grounded; 6/6 abstention queries rejected, including 1/1 quarantined-evidence check | 11/11 decisions correct |

The payload figure is a serialized JSON-shape estimate, not an MCP transport measurement or provider billing total. See the [Benchmark methodology](https://github.com/Coding-Dev-Tools/engraphis/blob/5bba9386b7600e10bcc89da3ad1f163408f181e3/BENCHMARKS.md) for artifact identity, counting methods, reproduction commands, external-evaluation boundaries, and limitations.
The payload figure is a serialized JSON-shape estimate, not an MCP transport measurement or provider billing total. See the [Benchmark methodology](https://github.com/Coding-Dev-Tools/engraphis/blob/a07ca9ad2d0be588b4595c2f14a7292ea4a9ac7d/BENCHMARKS.md) for artifact identity, counting methods, reproduction commands, external-evaluation boundaries, and limitations.

## Optional Jev assistance

Expand Down
Loading
Loading