Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions docs/reference-matrix.md
Original file line number Diff line number Diff line change
Expand Up @@ -316,6 +316,14 @@ not an additional source or validated mechanism.

## vLLM-Omni incremental abort/cleanup readset

The [source and responsibility map](../src/inferrsi/data/skill_library/repositories/vllm-omni/SKILL.md#source-and-responsibility-map)
links the original engine guide (`52194f24fa42e14d1c5e096f4bea4dc7f95cffa1`,
inspected 2026-10-14) and this incremental abort readset
(`18c3bd5d2d4323bc7adca1ac3c465c4a53bbfb6e`, inspected 2026-10-22).
Follow the [validation route](../src/inferrsi/data/skill_library/repositories/vllm-omni/sub-skills/omni-validation/SKILL.md)
for actual caller, receipt and cleanup questions. Existing readsets and the
three catalog records retain their own source attribution and validation limits.

| Source / revision | Inspected scope | Reuse, extraction and limits |
|---|---|---|
| vllm-project/vllm-omni @ `18c3bd5d2d4323bc7adca1ac3c465c4a53bbfb6e` (Apache-2.0) | Engine-base abort/ack APIs, correlated waiter/router, orchestrator companion and logical cleanup, stage-pool partial outputs and queued release; selected upstream test source and test bootstrap | Extend [existing omni-validation](../src/inferrsi/data/skill_library/repositories/vllm-omni/sub-skills/omni-validation/SKILL.md) with [three bounded mechanisms and pinned readset](../src/inferrsi/data/skill_library/repositories/vllm-omni/sub-skills/omni-validation/references/abort-acknowledgment.md). Reuse the original `52194f24...` engine guide and catalog ownership; no new skill or parallel database. CODE / TEST-SOURCE only; actual device, connector, model, service and performance not_run. Full duplex/session behavior and native abort guarantees deferred. |
Expand Down
7 changes: 7 additions & 0 deletions docs/searchspace-matrix.md
Original file line number Diff line number Diff line change
Expand Up @@ -338,6 +338,13 @@ not add a Communication/Network capability; no SSD or OS control is introduced.

## vLLM-Omni incremental abort guidance

Route general stage/model/output decisions through the
[engine source and responsibility map](../src/inferrsi/data/skill_library/repositories/vllm-omni/SKILL.md#source-and-responsibility-map).
For receipt, wait-only timeout or retained transfer resources, follow
[abort validation](../src/inferrsi/data/skill_library/repositories/vllm-omni/sub-skills/omni-validation/SKILL.md)
and its [three completion boundaries](../src/inferrsi/data/skill_library/repositories/vllm-omni/sub-skills/omni-validation/references/abort-acknowledgment.md#keep-three-completion-boundaries-separate).
The map keeps the engine and incremental abort source snapshots separate.

| Resource | Stage / named mechanism | Canonical owner | Evidence boundary |
|---|---|---|---|
| Accelerator / RAM / Host | Diagnose / Verify: abort submission, logical acknowledgment, partial AR output and separately queued transfer reclamation | [Abort acknowledgment reference](../src/inferrsi/data/skill_library/repositories/vllm-omni/sub-skills/omni-validation/references/abort-acknowledgment.md) under the existing validation skill | Source control-flow and queue ownership, not native device synchronization or measured release completion |
Expand Down
6 changes: 6 additions & 0 deletions src/inferrsi/data/skill_library/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -86,6 +86,12 @@ these imports and use generated abstracts rather than runtime repository packs.
| vLLM-Omni | Model/deploy separation, AR/diffusion and output contracts | [Skill](repositories/vllm-omni/SKILL.md) | [Records](../repo_packs/vllm_omni/knowledge/README.md) |
| Research router | Constrained engine design and validation | [Skill](workflows/inference-engine-research/SKILL.md) | — |

For vLLM-Omni, the
[source and responsibility map](repositories/vllm-omni/SKILL.md#source-and-responsibility-map)
routes broad stage/model/output decisions and the separate
[abort validation](repositories/vllm-omni/sub-skills/omni-validation/SKILL.md)
with their original inspection dates and source pins.

See the [collection overview](workflows/inference-engine-research/references/overview.md),
[import boundaries](workflows/inference-engine-research/references/import.md) and
[Strata design-space analysis](repositories/strata/references/design-space-analysis.md).
Expand Down
15 changes: 15 additions & 0 deletions src/inferrsi/data/skill_library/repositories/vllm-omni/SKILL.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,21 @@ Use this skill to explain, configure, tune or extend **vLLM-Omni** stage-based a

This is a source-grounded portable candidate at `52194f24fa42e14d1c5e096f4bea4dc7f95cffa1`. It is not a GPU certification or a complete model catalogue. Read [provenance](references/repo-provenance.md) when the checkout or installed packages differ.

## Source and responsibility map

Choose the scope before applying the existing procedures. The dates below are
the original inspections of two separate source snapshots.

| Decision scope | Canonical entry | Retained source / inspection | Evidence boundary |
| --- | --- | --- | --- |
| Stage/model topology, deployment, streaming measurement and step/output contracts | [Architecture](sub-skills/omni-architecture/SKILL.md), [serving](sub-skills/omni-serving/SKILL.md) and [extension](sub-skills/omni-validation/references/validation.md) | `52194f24fa42e14d1c5e096f4bea4dc7f95cffa1`; 2026-10-14; Apache-2.0 | Original source-derived candidate; establish the selected model/backend and producer/consumer contract |
| Abort submission/receipt, wait-only timeout, partial output, logical cleanup and deferred transfer release | [Abort validation](sub-skills/omni-validation/SKILL.md) and its [completion boundaries](sub-skills/omni-validation/references/abort-acknowledgment.md#keep-three-completion-boundaries-separate) | `18c3bd5d2d4323bc7adca1ac3c465c4a53bbfb6e`; 2026-10-22; Apache-2.0 | Bounded CODE / TEST-SOURCE; logical acknowledgment and native transfer reclamation are separate completion boundaries |

Keep each row with its own [provenance](references/repo-provenance.md) and
[evidence](references/evidence.md). The later readset supplements only the
abort path; the two snapshots do not define a jointly tested runtime or
compatibility range.

## Route by decision

| Need | Load |
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,14 @@ Read [extension and validation contracts](references/validation.md) before chang

For abort receipts, partial outputs, timeout or retained transfer resources, load [abort acknowledgment](references/abort-acknowledgment.md). Its incremental source pin is `18c3bd5d2d4323bc7adca1ac3c465c4a53bbfb6e`; keep it distinct from the original engine guide's pin. An abort acknowledgment covers logical teardown while transfer reclamation may still be queued.

The [engine source and responsibility map](../../SKILL.md#source-and-responsibility-map)
separates this supplement from the 2026-10-14 stage/model and output guide at
`52194f24fa42e14d1c5e096f4bea4dc7f95cffa1`. Use the original
[validation contracts](references/validation.md) for general extension gates;
for the later abort path, follow its
[completion boundaries](references/abort-acknowledgment.md#keep-three-completion-boundaries-separate)
and [correlation/timeout ownership](references/abort-acknowledgment.md#correlation-and-timeout-ownership).

Document the reference model semantics and the complete producer/consumer contract first. Preserve per-request RNG, accumulated output/state, replica affinity, abort semantics and resource lifetime. Validate ordinary completion and injected failure paths.

Escalate evidence from static checks to CPU/native contract tests, then required accelerator parity, real-model media quality and matched performance. An unavailable required backend leaves that claim `BLOCKED_REQUIRED_BACKEND`; do not substitute an import or mock test.
Expand Down
Loading