Repository navigation
feat(llm): integrate shared model routing and request admission - #243
Merged
Merged
Conversation
KaiEureka
force-pushed
the
codex/shared-model-routing
branch
from
October 24, 2026 03:14
c7d4efe to
0261234
Compare
KaiEureka
force-pushed
the
codex/session-docker-isolation
branch
from
October 24, 2026 03:23
cb78bc2 to
1e71d65
Compare
KaiEureka
force-pushed
the
codex/shared-model-routing
branch
from
October 24, 2026 03:23
0261234 to
b57e6c8
Compare
KaiEureka
force-pushed
the
codex/shared-model-routing
branch
from
October 24, 2026 03:54
9f83918 to
68206f6
Compare
This was referenced Oct 24, 2026
KaiEureka
marked this pull request as ready for review
October 24, 2026 04:23
KaiEureka
force-pushed
the
codex/shared-model-routing
branch
from
October 24, 2026 05:17
68206f6 to
aefc373
Compare
Resolve logical model routes before capability selection and preserve physical provider identity across agent, team, workflow and SDK client paths. Share same-host request capacity through OS-backed slot locks, retaining ownership through retries and native cancellation cleanup. Document external gateways for cross-host admission and verify real concurrent HTTP traffic from independent Team and Workflow processes.
KaiEureka
force-pushed
the
codex/shared-model-routing
branch
from
October 24, 2026 05:40
aefc373 to
b06d963
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds logical model routes and shared request admission for independently started OC runs. A route resolves to an explicit physical model, provider and endpoint before capability checks. Processes on one host can share an existing request-pool directory; multi-host deployments use their configured common model gateway.
Request slots cover actual provider work and cancellation cleanup. Waiting for a slot is excluded from the generation timeout, while real generation deadlines and late-usage ownership remain intact. Team entry-role routing, CLI credentials, physical-model fallbacks and secret-free configuration errors match the SDK behavior.
Validation includes four independent Team/Workflow processes using two loopback HTTP backends with a shared capacity of two, a capacity-one parent/child run, queue cancellation, delayed cleanup and native retries. Independent review reproduced and repaired queue timeout, CLI routing and credential-diagnostic defects. The integrated isolation/Docker/model tree passed 67 focused tests. The model review also passed 95 timeout/admission cases and 180 CLI cases. Legacy duck-typed model clients retain optional-field compatibility. Ruff, import-linter and deptry pass. The final merge review passed 46 routing/admission tests and 543 existing compatibility regressions. The updated head includes both reviewed Docker import fixes. All final-head GitHub checks pass, including the complete Python 3.10–3.14 suites.
This is the third part of the runtime feature series, building on #242. Managed member-authored runs follow in #244.