Skip to content
This repository was archived by the owner on Oct 9, 2026. It is now read-only.
This repository was archived by the owner on Oct 9, 2026. It is now read-only.

Codex Lab MVP dogfood plan #28

Closed
14 of 14 issues completed
Closed

Description

@shiny-code-bot

Finish Line

Codex Lab reaches MVP when one provenance-verified current binary supports the three workflows required for real product dogfood:

  1. Automatic Validation runs after relevant code changes, emits bounded structured results, and permits at most one controlled correction cycle. The MVP preserves parser and project-command validation and includes at least one automatically selected changed-file executable provider.
  2. Third-party agents launch through the native agent system with workspace/session provenance, bounded status and output, completion/failure/timeout/cancellation cleanup, and terminal-state recovery proven from the current binary.
  3. Automatic Background Review runs detached after completed code-changing turns, records durable current findings, avoids duplicate/stale noise, and remains distinct from manual Review and Approval Review/Guardian.

History/resume, auth, provenance, TUI status, and upstream substrate work are MVP requirements only where they are necessary to run these workflows safely. Once the three workflows pass deterministic and bounded current-binary smoke gates, Codex Lab begins real dogfood with Every Code retained as rollback. Broad upstream parity, architecture thinning, polish, and the permanent default-route soak are post-MVP unless a dogfood failure promotes a specific item.

Current Status

The admitted upstream recovery #928 is complete through PR #934 at d83017f. Frozen qualification took 7h48m31s and landing took 9h02m15s from the original unpaused T0. The qualified source passed 20,313 workspace tests, focused regressions, scoped Clippy, CI/artifact checks and actual Opus/Gemini reviews; postmerge CI passed 15 jobs. IDE freshness remains explicitly UNKNOWN and a passing leaky-test observation is preserved. This establishes one recovery's feasibility, not #634 ordinary-refresh automation or comparative speedup.

Direction remains tooling/convergence, lab.8 release preparation and protected #787 Background Review delivery, then broader thinning only when justified by a measured need. #929's additional nonpublishing release gates found one stale test annotation; reviewed one-line PR #937 repairs it while the remaining rehearsal jobs finish. Repaired main needs a fresh successful rehearsal, exact artifact/signature/symbol verification and Opus/Gemini final release review before owner publication approval. No lab.8 artifact, publication or installed acceptance is claimed yet.

#787 is prepared independently in draft PR #936 at 0657684, with 61 focused tests, 4,924 codex-core tests and scoped all-target Clippy passing, plus actual Opus/Gemini source approval. A documented remote-mock retry remains unexplained. Its complete-workspace approval is pending; CI and installed dogfood remain open. This product slice is not a lab.8 publication dependency.

The affected issue graph is being reconciled to these observations. #926 was absorbed into existing plans and closed; #908 was reconciled through #933. #634 remains open for ordinary-refresh/automation proof and #230 owns cadence/lag: canonical upstream was 54 commits beyond the frozen target at 06:20Z, with no new target admitted. Release publication, installation, GUI, native-provider acceptance and code-route activation retain their separate gates. Live evidence and remaining work are owned by #928, #929 and #787.

This closed recovery anchor stays closed; the linked live issues own execution.

Source Material

Use restored cbusillo/code issues and commits as historical source material, not as automatic carry-forward status. Important restored planning issues include:

Recent restored commits worth mining include the Codex substrate migration, Codex Desktop startup compatibility, Every Code identity/config alignment, feature inventory, parity ledger, prompt-cache prefix preservation, auto-review proof metrics, auto-review lifecycle/store/ledger work, agent context file preloading, worktree decision gate hardening, and release/build runner fixes.

Base Platform Decision

Codex Lab remains the product base. Build on the Codex CLI/Desktop/app-server substrate because the hard-to-recreate value is Codex Desktop compatibility, Codex iOS/mobile control of Desktop, Codex subscription auth, upstream openai/codex compatibility, and continuity with the Every Code Codex-base port path.

opencode and other coding harnesses are reference implementations, not the base. Steal ideas when they improve Codex Lab without breaking Codex compatibility and can be validated through the exec harness or focused tests.

Guardrails

  • Use fixtures/tests/concepts before broad implementation overlays where feasible.
  • Treat missing Every Code behavior as unclassified until this plan or a child issue records Port, Rewrite, Covered, Defer, or Retire.
  • Keep openai as fetch-only upstream.
  • Avoid direct work on protected/default branches; use focused task branches and PRs for implementation.
  • Every code-bearing port slice should include scoped validation evidence.
  • The exec harness is mandatory for Codex Lab-specific regressions: skills prompt strength, cached-token stability, thread continuity, Desktop/app-server compatibility, and Every Code workflow expectations.
  • Cache-sensitive scenarios should compare input tokens, cached input tokens, cache ratio, and normalized prompt-prefix stability against explicit baselines.

MVP Slices

  1. Repo and runner recovery.

    • Verify cbusillo/codex-lab runners after repo move.
    • Keep cbusillo/code runner-free unless a future archival workflow explicitly needs one.
  2. Planning source of truth.

    • Make this issue the durable parent plan.
    • Create focused child issues for independent MVP slices.
    • Realign repo AGENTS.md so future agents find this issue instead of relying on local plan files.
  3. Exec harness hardening and regression gates.

    • Fix known automation findings: cleanup just argument forwarding and exec-harness workflow path triggers.
    • Add skills-cache-continuity as the first cache-sensitive scenario.
    • Add deterministic fake-Responses coverage first, then local-LLM dogfood and frontier release variants.
  4. Skills and prompt-cache protection.

    • Protect against skills becoming less directive or being treated as optional advice.
    • Protect against prompt-stack churn reducing cached-token reuse.
  5. Auto Review proof loop.

    • Restore actionable review evidence without broad-review noise.
    • Mine restored Every Code auto-review lifecycle/store/ledger commits and issues before implementation.
  6. Agents and third-party agent orchestration.

    • Rebuild configurable agent roles, third-party agents, local LLM roles, and review/validation loops on Codex Lab primitives.
  7. Codex Desktop/app-server compatibility.

    • Validate Codex Lab in Desktop and keep app-server behavior upstream-shaped unless an additive extension is explicitly validated.
  8. Code Bridge/browser and remote-control workflows.

    • Preserve or replace Code Bridge/browser/control capability with clear Desktop/app-server boundaries.
  9. Auto Drive.

    • Rebuild Auto Drive on validated Codex thread/session/worktree/token primitives rather than copying old implementation wholesale.
  10. Local LLM dogfood.

    • Make LM Studio/OpenAI-compatible local endpoints first-class for bounded dogfood basics, then graduate roles only after repeated proof.

Opencode And Other References

opencode is the primary near-term reference for plugin/hooks ergonomics, named agents/subagents, LM Studio flow, provider/auth boundaries, permissions UX, run artifacts, GitHub automation presentation, prompt/context controls, and MCP/tool discovery.

Keep a lightweight watch on OpenHands, SWE-agent/mini-SWE-agent, Aider, Cline/Roo Code, Goose, and Continue for product architecture ideas. Separately, keep Terminal-Bench, promptfoo, Inspect AI, SWE-bench, Aider benchmarks, and BrowserGym/WebArena/OSWorld in mind for eval and grading ideas. These are references only.

Next Actions

  1. Begin bounded opt-in Codex Lab dogfood from merged source 357b8e4ac06053968ba2a5232c4369bcec849458; keep Every Code available as the immediate rollback route.
  2. Record concrete dogfood regressions as focused issues and promote only those defects into blocking work.
  3. Continue Define Every Code-owned convergence contracts #126/Upstream sync and Codex Lab feature reclassification #229 upstream classification and synchronization without retroactively reopening the MVP unless a material workflow regression is found.
  4. Use Cut over to converged Codex Lab baseline and primary harness #343 for paired quality evaluation, rollback/re-entry, multi-day soak, and the eventual permanent default-route decision.
  5. Treat Adopt Background Review terminology across product surfaces #303, Sync TUI, Guardian, and CI substrate #308, Reduce managed approval friction in dogfood workflows #313, Surface structured rate-limit diagnostics for Claude CLI agents #315, and Add a lightweight structured LLM request side channel #319 as post-MVP terminology, presentation, friction, diagnostics, or observability work.

Relationships

Post-Cutover Roadmap

As of July 29, 2026, this closed issue remains the durable MVP evidence and historical recovery point. The active post-cutover roadmap is #498.

Current queue:

Future sessions should recover MVP intent here, then use #498 for current direction and sequencing.

Execution Recovery

Execution resumed with owner authorization on September 10. Follow #498 for the roadmap and #902 for the finite frozen-upstream catch-up; upstream target stays a62e98d18c6550e3bea152ed1b89d1e931dca961. Preserved integration reuse plus newer-main conflict resolution produced current source checkpoint 9a71ebdb32ce496dd2ad1b7463ca04a287958eff; 139 upstream conflicts remain, with complete residual/trust allocation recorded in #902. No completed convergence/build claim. Frozen main #903 at 49abf185 is integrated; exact reinspection found unchanged conflict/residual path sets. The complete implementation allocation is recorded in #902. #787 has a bounded first safety-slice design and retains protected harness priority.

Release publication/routing trackers #845 and #879 are now closed after evidence and stale-dependency reconciliation. Lab.6 remains published and installed at 914874727a60168626bc6d720c53cf35d88252cb, bundle 78. #844 records successful supported rollback to lab.5 and restore to lab.6 plus saved-thread continuity; #850 records installed Astra/Sol cache reuse and remaining wire/transport qualification gaps.

Native Gemini acceptance exposed provider CLI lookup failure from the installed supervisor PATH. #904 owns the focused fix in PR #905; source tests pass, IDE evidence is UNKNOWN/stale, Opus/Gemini final reviews and all ordinary CI/app checks passed; the normal merge/provisioning decision and explicit IDE-gap acceptance remain with the owner. No patched provisioning has been applied. #844 also retains GUI coordination with the running official Codex app. The code route stays Every Code; preserve rollback assets and all existing worktrees. Earlier planning-only language and publication waiting steps are historical, not current instructions.

Activity

  1. shiny-code-bot commented on Jun 12, 2026

    @shiny-code-bot
    CollaboratorAuthor

    Runner proof after repo recovery passed.

    Evidence:

    This proves cbusillo/codex-lab can dispatch to the chris-testing-codex self-hosted Linux runner after the repo rename/transfer. The stale local code macOS runner was removed earlier; cbusillo/code should remain runner-free unless a future archival workflow explicitly needs one.

  2. shiny-code-bot commented on Jun 12, 2026

    @shiny-code-bot
    CollaboratorAuthor

    Planning source-of-truth cleanup:

    • Retired the temporary local draft /Users/cbusillo/.code/plans/codex-lab-mvp.md now that this issue exists.
    • Updated handoff.md to point future sessions at this issue as the recovery point.

    Future Codex Lab MVP planning should live here or in child issues/repo artifacts, not in the old local draft.

  3. 44 remaining items

  4. cbusillo commented on Jul 17, 2026

    @cbusillo
    Owner

    Dogfood evidence 2026-07-17 UTC:

  5. added
    plan:donePlan completed or superseded
    and removed
    plan:activePlan is actionable now
    on Jul 17, 2026
  6. shiny-code-bot commented on Jul 17, 2026

    @shiny-code-bot
    CollaboratorAuthor

    Codex Lab MVP completed on July 17, 2026. The exact merged source 357b8e4ac06053968ba2a5232c4369bcec849458 produced a clean current binary with digest 868bc4dbef504047fc19b732daf233494094b2556586f7e7f07e091bb8360e2a; all 13 deterministic scenarios passed in one suite. Automatic Validation, third-party agents, and Automatic Background Review are implemented and proven. Real opt-in dogfood can begin now with Every Code retained as rollback; #343 owns the later permanent default-route soak and graduation.

  7. cbusillo commented on Jul 27, 2026

    @cbusillo
    Owner

    Recovery-point update: PR #465 candidate is clean at a5f9dfacc432612dcc68c14173f5b9615a8b267b after merging #480, #481, and the PowerShell compatibility rollback #482. Current blocking CI and app build are green. Full CI, Bazel, and V8 validation are blocked only because repeated runs were explicitly cancelled by @cbusillo; exact run IDs and restart instructions are recorded in #428. PR #465 remains draft and must not be merged/undrafted during cutover.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    planDurable planning issueplan:donePlan completed or superseded

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions