Skip to content

feat(llm): integrate shared model routing and request admission - #243

Merged
KaiEureka merged 10 commits into
mainfrom
codex/shared-model-routing
Oct 24, 2026
Merged

KaiEureka merged 10 commits into
mainfrom
codex/shared-model-routing

Conversation

@KaiEureka

@KaiEureka KaiEureka commented Oct 24, 2026 •

Copy link
Copy Markdown
Collaborator

Adds logical model routes and shared request admission for independently started OC runs. A route resolves to an explicit physical model, provider and endpoint before capability checks. Processes on one host can share an existing request-pool directory; multi-host deployments use their configured common model gateway.

Request slots cover actual provider work and cancellation cleanup. Waiting for a slot is excluded from the generation timeout, while real generation deadlines and late-usage ownership remain intact. Team entry-role routing, CLI credentials, physical-model fallbacks and secret-free configuration errors match the SDK behavior.

Validation includes four independent Team/Workflow processes using two loopback HTTP backends with a shared capacity of two, a capacity-one parent/child run, queue cancellation, delayed cleanup and native retries. Independent review reproduced and repaired queue timeout, CLI routing and credential-diagnostic defects. The integrated isolation/Docker/model tree passed 67 focused tests. The model review also passed 95 timeout/admission cases and 180 CLI cases. Legacy duck-typed model clients retain optional-field compatibility. Ruff, import-linter and deptry pass. The final merge review passed 46 routing/admission tests and 543 existing compatibility regressions. The updated head includes both reviewed Docker import fixes. All final-head GitHub checks pass, including the complete Python 3.10–3.14 suites.

This is the third part of the runtime feature series, building on #242. Managed member-authored runs follow in #244.

@KaiEureka
KaiEureka force-pushed the codex/shared-model-routing branch from aefc373 to b06d963 Compare October 24, 2026 05:40
Base automatically changed from codex/session-docker-isolation to main October 24, 2026 06:32
@KaiEureka
KaiEureka merged commit 7eff5b4 into main Oct 24, 2026
14 checks passed
@KaiEureka
KaiEureka deleted the codex/shared-model-routing branch October 24, 2026 06:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant