Skip to content
This repository was archived by the owner on Oct 9, 2026. It is now read-only.
This repository was archived by the owner on Oct 9, 2026. It is now read-only.

Validate Auto Review and third-party agents for dogfood MVP #53

Closed
9 of 9 issues completed
Closed

Description

@shiny-code-bot

Current Status

Updated 2026-06-14 by Code.

State: Active umbrella. The native Auto Review dogfood spine is complete enough for daily workflow validation, the first third-party/external agent dogfood path is complete and hardened enough to rely on, and the Codex Lab home/repo-dotdir boundary has now landed.

Completed dogfood spine:

Current sequence:

  1. Scope minimal Code Bridge vertical slice #36/Define Code Bridge protocol, trust, and payload contract #45-Gate thin app-server integration for Code Bridge #50 - Resume Code Bridge vertical-slice work now that Codex Lab home and repo-dotdir boundaries are settled.
  2. Provider-agnostic worker decision spike #2 - Keep as the broader provider-agnostic worker strategy spike. Implement native third-party agent dogfood path #58 proves the first concrete dogfood backend and Harden external-agent spawn graph and cancellation handling #85 hardens its lifecycle; neither settles streaming, resume/full-history fork support, app-server runtime API, richer provider/auth strategy, usage/quota accounting, or broader UX polish.

Product boundary remains unchanged:

  • Use native Codex review/runtime/context primitives wherever possible.
  • Do not copy Every Code plugin systems.
  • Removed auto-review@just-every and ultracode@just-every plugins remain reference-only.
  • Code Bridge stays after the dogfood/home-boundary foundation, and is now the next MVP workstream.

Finish Line

Codex Lab is dogfood-ready by the user's definition: Auto Review works in the real daily workflow, and third-party agent providers are validated enough for daily use with clear limits and fallback behavior.

Acceptance Criteria

  • Define the concrete dogfood workflow for Auto Review: when it runs, how findings are surfaced, how stale/detached findings are suppressed, and how details are recovered.
  • Validate Auto Review outside the narrow exec-harness proof loop, or record the smallest missing implementation issue if runtime wiring is absent.
  • Define the third-party agent provider dogfood bar: supported providers/models, auth/config source, lifecycle commands, cancellation/wait/output collection, usage/quota accounting, and failure/degraded behavior.
  • Validate at least one non-OpenAI/third-party agent provider path end to end, or record the smallest missing implementation issue if runtime support is absent.
  • Decide whether Provider-agnostic worker decision spike #2 should be promoted from waiting to active implementation, split into child issues, or closed by a narrower dogfood contract.
  • Update Codex Lab MVP dogfood plan #28 and Run Codex Lab dogfood readiness sweep #52 language so GO means covered-spine-only unless this issue is also complete.

Relationships

Child of #28. Blocks treating Code Bridge (#45-#50) as the only remaining MVP work. Related to #2 and #35.

Activity

  1. cbusillo commented on Jun 14, 2026

    @cbusillo
    Owner

    Dogfood evidence from the old Every Code auto-review ledger, useful as a regression case for this umbrella and the already-merged #57/#62/#79/#80 direction.

    Observed repeatedly in cbusillo/codex-skills on June 14, 2026:

    • The model-visible auto-review ledger surfaced a completed detached proposal run as freshness=Current target=matching_head.
    • The run was for branch auto-review-628291b6, snapshot prefix 628291b61b7d, with finding locations under .code/working/codex-skills/branches/auto-review-628291b6/....
    • The active/default codex-skills target had already moved on; those two findings were re-verified fixed on origin/main.
    • The ledger diagnostics also reported suppressed_stale=12, so stale suppression existed in some form, but this detached run still appeared as current/matching-head context and kept being pasted back into the active agent turn.

    Why this matters for Codex Lab CLI:

    • This is exactly the failure mode the native design should prevent: stale/detached proposal findings should not appear as current actionable findings once the active checkout/worktree/head no longer matches.
    • The merged Codex Lab direction looks right: current/latest summary filtering, explicit target/freshness state, bounded detail retrieval by run/finding id, and stale/detached counts without raw stale findings in normal context.
    • Please keep this as a regression scenario when validating the dogfood MVP: create a detached/old review run with findings, move the active target forward so the findings no longer match, and verify the normal awareness/summary path reports it only as stale/detached count or diagnostic history, not as matching_head actionable feedback.

    No new issue seems necessary unless Codex Lab reproduces the stale surfacing behavior; this comment is intended to sharpen the acceptance criteria for the existing Auto Review dogfood path.

  2. added
    plan:donePlan completed or superseded
    and removed
    plan:activePlan is actionable now
    on Jun 16, 2026
  3. shiny-code-bot commented on Jun 16, 2026

    @shiny-code-bot
    CollaboratorAuthor

    Closing as completed after #48 was closed and the active-plan audit confirmed this umbrella is done.

    The Auto Review and third-party dogfood spine is complete enough for daily workflow validation:

    The remaining MVP work now moves through the Code Bridge workstream under #36. Broader provider-agnostic strategy remains tracked separately in #2.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    planDurable planning issueplan:donePlan completed or superseded

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions