Skip to content

docs: preserve reliability results and taxi demonstration evidence - #9

Draft
hudsonaikins wants to merge 10 commits into
codex/numeric-evidence-completionfrom
codex/reliability-campaign-plan
Draft

hudsonaikins wants to merge 10 commits into
codex/numeric-evidence-completionfrom
codex/reliability-campaign-plan

Conversation

@hudsonaikins

@hudsonaikins hudsonaikins commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

The owner froze BackIntel's reliability campaign. This package preserves the initial 92-response report and subsequent 46-response checkpoint, including all mandatory failures. The prepared generation-3 rerun is shelved and its $7 request withdrawn; no release acceptance is claimed.

The requested practical taxi demonstration has now run on 11,198,026 official Q1 2025 yellow-taxi records with GPT-6.1 Sol through the ChatGPT subscription. The first pass returned cannot_answer; the single repair completed its analysis and chart rendering, then failed final clean-VM export with ReadError: unexpected end of data. HTML/XLSX are not delivered. Five unchanged PNG previews were recovered from the trace and match the last successful render manifest. Three numerical claims matched independent raw-source SQL. The assessment remains needs_revision.

Two taxi attempts consumed 50 subscription model calls and 1007.818 seconds; no per-request dollar charge or paid fallback is claimed. No third attempt is planned. INT-498 tracks the observed single-report transfer defect; INT-454 tracks specific visual polish gaps.

This PR remains draft, stacked on #13, #8 and #10. Runtime source is unchanged at 9463f7cec50ccc9e, matching #13. Its 277-test implementation result is separate from live acceptance. Documentation/assessment changes passed JSON, raw-source checks, image hash comparisons and git diff --check. No merge, tag, release or deployment is performed.

@hudsonaikins
hudsonaikins force-pushed the codex/reliability-campaign-plan branch from 6dcba9c to 721301f Compare November 13, 2026 23:51
@hudsonaikins
hudsonaikins changed the base branch from main to codex/native-provider-credits November 13, 2026 23:51
@hudsonaikins hudsonaikins changed the title Prepare the frozen 92-response reliability campaign Freeze the reliability campaign and record the recovered regression comparison Nov 14, 2026
@hudsonaikins hudsonaikins changed the title Freeze the reliability campaign and record the recovered regression comparison Qualify v0.0.1 reliability and prepare the release review package Nov 14, 2026
@hudsonaikins
hudsonaikins changed the base branch from codex/native-provider-credits to codex/analyst-judge-context November 14, 2026 02:04
@hudsonaikins hudsonaikins changed the title Qualify v0.0.1 reliability and prepare the release review package Record the complete v0.0.1 comparison and reserved rejection Nov 14, 2026
@hudsonaikins hudsonaikins changed the title Record the complete v0.0.1 comparison and reserved rejection Package report validation and preserve both qualification checkpoints Nov 14, 2026
@hudsonaikins
hudsonaikins changed the base branch from codex/analyst-judge-context to codex/numeric-evidence-completion November 14, 2026 04:02
@hudsonaikins hudsonaikins changed the title Package report validation and preserve both qualification checkpoints docs: preserve reliability results and define the real-data demonstration Nov 14, 2026
@hudsonaikins hudsonaikins changed the title docs: preserve reliability results and define the real-data demonstration docs: preserve reliability results and taxi demonstration evidence Nov 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant