Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions docs/knowledge-base.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ separate work, not an implemented capability of this knowledge base.
```text
src/inferrsi/data/skill_library/
README.md Library navigation
skill-index.json Stable IDs → categorized paths/backend (74 skills)
skill-index.json Stable IDs → categorized paths/backend (76 skills)
hardware/{ascend,cuda,host}/<id>/ Hardware/platform-specific complete skills
frameworks/<framework>/<id>/ Framework-owned complete skills
repositories/<repo>/ Engine entry, sub-skills and focused complete skills
Expand Down Expand Up @@ -166,23 +166,23 @@ standalone export: retain the declared dependencies or the complete library.

All 48 former root skills now have one canonical home under
[`src/inferrsi/data/skill_library/`](../src/inferrsi/data/skill_library/README.md).
Complete procedures, sidecars, references and cases are packaged, with 13 Ascend,
Complete procedures, sidecars, references and cases are packaged, with 14 Ascend,
3 CUDA and 5 host skills under `hardware/`; the rest are grouped as frameworks,
repositories, methods or workflows. The 21 engine and research-router skills
use the same ownership layout under `repositories/<engine>/` and
`workflows/inference-engine-research/`, including their sub-skills and references.
The library contains 119 `SKILL.md` files, all in English.
The library contains 120 `SKILL.md` files, all in English.
The collection overview, import notes and source manifest belong to the research
workflow's references; Strata design-space analysis belongs to Strata. The library
root contains only navigation and the registry.

The [generated catalog](../src/inferrsi/data/repo_packs/inferrsi/knowledge/README.md)
projects the 75 registered skills into the contribution catalog. Its records
projects the 76 registered skills into the contribution catalog. Its records
use `inferrsi.<backend>.skills.<name_with_underscores>` IDs, with `ascend` and
`cuda` for scopes that depend on those backends and `common` for the remaining skills.
Each `skill_documents.original` points to the full packaged procedure. The
`skills` CLI retains the original hyphenated skill IDs and defaults to this
75-ID registry; engine procedures remain available through library navigation
76-ID registry; engine procedures remain available through library navigation
and catalog document pointers.

The registered [h3.c runtime audit](../src/inferrsi/data/skill_library/repositories/h3-c/audit-h3-runtime-residency/SKILL.md)
Expand Down
25 changes: 13 additions & 12 deletions docs/skill-coverage.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ Generated from the registry, the skill sidecars and the two maintained
matrices. **Do not edit by hand**; regenerate after any registry, skill,
matrix or frozen-plan change.

- Input digest: `sha256:cb1fedb4292b272ef63223dd29fa1fc483c63cd0cee74397ad7aa17dbf3a5321`
- Input digest: `sha256:61b440f9e3333b2ad1e1aac0b9808b1610e389e0a96c151f38d3df931758daed`
- Regenerate: `python tools/build_skill_coverage.py`
- Verify without writing: `python tools/build_skill_coverage.py --check`

Expand All @@ -31,16 +31,16 @@ matrix: every field is copied from an owner that already maintains it.

| Measure | Value |
|---|---|
| Registered skill ids | 75 |
| By category | frameworks 3, hardware 22, methods 19, repositories 25, workflows 6 |
| By backend | ascend 14, common 56, cuda 5 |
| Registered skill ids | 76 |
| By category | frameworks 3, hardware 22, methods 20, repositories 25, workflows 6 |
| By backend | ascend 14, common 57, cuda 5 |
| Recorded on a numbered SearchSpace resource layer | 48 |
| Recorded only in a supplementary guidance table (†) | 13 |
| Recorded on two or more resource layers | 24 |
| Recorded in the Reference Matrix | 68 |
| With a `metadata.json` sidecar | 70 |
| With a `metadata.json` sidecar | 71 |
| Selected by a frozen evaluation plan | 2 |
| `SKILL.md` documents in the library | 119 |
| `SKILL.md` documents in the library | 120 |
| Unregistered documents (excluded from every count above) | 44 |

A complete inventory is not a coverage claim. Every registered row below
Expand All @@ -60,7 +60,7 @@ optimization is fully covered or that any procedure has measured benefit.
| [ascend-operator-tuning](../src/inferrsi/data/skill_library/hardware/ascend/ascend-operator-tuning/SKILL.md) | ascend | Run a staged, accuracy-gated tuning campaign on a single Ascend NPU operator: set a numeric target up front, block ... | 1 Accelerator · Optimize | 1 · Systems sources (ascend-ai-coding/awesome-ascend-skills @ 75ec89c) | candidate · not_run · 0 readset(s) | no-eval |
| [ascend-optimization-casebook](../src/inferrsi/data/skill_library/hardware/ascend/ascend-optimization-casebook/SKILL.md) | ascend | Casebook of NPU optimization cases for Ascend inference systems: symptom → diagnosis → action → evidence records for ... | 1 Accelerator · Optimize / Verify | 1 · Systems sources (Ascend/MindIE-SD @ 8481d39) | candidate · not_run · 0 readset(s) | no-eval |
| [ascend-performance-analysis](../src/inferrsi/data/skill_library/hardware/ascend/ascend-performance-analysis/SKILL.md) | ascend | Diagnose performance bottlenecks on Ascend NPU systems using CANN profiling data. Maps GPU profiling concepts (nsys ... | 1 Accelerator · Observe / Profile / Diagnose / Verify<br>4 Network · Observe / Profile / Diagnose / Verify<br>5 OS · Diagnose | 1 · Systems sources (Ascend/MindIE-SD @ 8481d39)<br>1 · Systems sources (cann/cannbot @ `c0e2ad23ee1a73e3c0f84c8df1cc459e2aae3110` (selected ...) | candidate · not_run · 1 readset(s) | no-eval |
| [ascend-video-diffusion-optimization](../src/inferrsi/data/skill_library/hardware/ascend/ascend-video-diffusion-optimization/SKILL.md) | ascend | Run and verify goal-driven Ascend video diffusion optimization. Use when the user asks for latency, RTF, throughput, or ... | — | — | candidate · not_run · 1 readset(s) | no-SearchSpace-layer, no-Reference-Matrix-row, no-eval |
| [ascend-video-diffusion-optimization](../src/inferrsi/data/skill_library/hardware/ascend/ascend-video-diffusion-optimization/SKILL.md) | ascend | Run and verify goal-driven Ascend video diffusion optimization. Specializes the backend-agnostic ... | — | — | candidate · not_run · 1 readset(s) | no-SearchSpace-layer, no-Reference-Matrix-row, no-eval |
| [ascendc-tiling-design](../src/inferrsi/data/skill_library/hardware/ascend/ascendc-tiling-design/SKILL.md) | ascend | Design tiling for a custom AscendC operator: normalize the shape first (axis-collapse or flatten), answer the ... | 1 Accelerator · Optimize | 1 · Systems sources (ascend-ai-coding/awesome-ascend-skills @ 75ec89c) | candidate · not_run · 0 readset(s) | no-eval |
| [cann-attribution-overlap](../src/inferrsi/data/skill_library/hardware/ascend/cann-attribution-overlap/SKILL.md) | ascend | Attribute NPU trace kernels to model source and plan bounded multistream overlap: select a representative step, map ... | 1 Accelerator · Observe / Profile / Diagnose / Optimize / Verify<br>4 Network · Diagnose / Optimize / Verify | 1 · Systems sources (cann/oam-tools @ `8440935f` (!302 import; later master `f3cf4115` ...) | candidate · not_run · 0 readset(s) | no-eval |
| [cgroup-resource-controls](../src/inferrsi/data/skill_library/hardware/host/cgroup-resource-controls/SKILL.md) | common | Diagnose and configure cgroup v2 resource controls for serving/training workloads: distinguish quota stalls from ... | 2 RAM/Host · Observe / Profile / Configure / Verify<br>5 OS · Observe / Profile / Diagnose / Configure / Optimize / Verify | 1 · Systems sources (Linux cgroup v2 docs — kernel.org live 2026-10-15 (revision ...) | candidate · not_run · 0 readset(s) | no-eval |
Expand Down Expand Up @@ -112,7 +112,7 @@ optimization is fully covered or that any procedure has measured benefit.
| [splash](../src/inferrsi/data/skill_library/repositories/splash/SKILL.md) | common | Investigate Splash model-format compatibility, automatic memory planning, Metal and ANE execution, DFlash2 ... | — | Splash portable AREX extraction (incoai/splash @ `39a97385f8560cf8a93972cec9b0a963c9195250`; AREX ...) | candidate · partial_cpu_only · 2 readset(s) | no-SearchSpace-layer, no-eval |
| [vllm-metal](../src/inferrsi/data/skill_library/repositories/vllm-metal/SKILL.md) | common | Investigate vllm-metal Apple inference through platform and native-ABI selection, paged KV/offload ownership ... | 1 Accelerator † guidance: vLLM Metal selected source contracts<br>2 RAM/Host † guidance: vLLM Metal selected source contracts<br>3 SSD † guidance: vLLM Metal selected source contracts | vLLM Metal portable AREX source and CPU extraction (vllm-project/vllm-metal @ `e7df7a6ff215f99c7842552d230fdbc709835934` ...) | candidate · partial_cpu_only · 2 readset(s) | no-eval |

## Registered: Methods (19)
## Registered: Methods (20)

| Skill | Backend | Declared task | SearchSpace layer / stage | Reference Matrix | State | Gaps |
|---|---|---|---|---|---|---|
Expand All @@ -134,6 +134,7 @@ optimization is fully covered or that any procedure has measured benefit.
| [skill-evolution-playbook](../src/inferrsi/data/skill_library/methods/skill-evolution-playbook/SKILL.md) | common | Practical design choices for evolving agent skills from execution traces: when one trajectory should update a skill ... | — | 2 · Methodology and corpus references (Qwen-Applications/Trace2Skill @ 3d0b52a)<br>2 · Methodology and corpus references (microsoft/SkillOpt @ 343db22) | candidate · not_run · 0 readset(s) | no-SearchSpace-layer, no-eval |
| [training-input-pipeline](../src/inferrsi/data/skill_library/methods/training-input-pipeline/SKILL.md) | common | Diagnose training input stalls and choose bounded queue, shard-cache and cache-ownership changes from DALI, Mosaic ... | 1 Accelerator · Observe / Configure / Optimize<br>2 RAM/Host · Observe / Diagnose / Configure / Optimize<br>3 SSD · Diagnose / Configure / Optimize<br>4 Network · Configure / Optimize<br>5 OS · Configure / Optimize | 1 · Systems sources (B1 / NVIDIA DALI @ `6fe47c48d3b0ca335f5e1afd3c77c750b2c7e041` ...)<br>1 · Systems sources (B2 / Mosaic Streaming @ `d99bf9c7cdf2dd4ed62a4960ed35270b93337a5f` ...)<br>1 · Systems sources (B3 / FFCV @ `3a12966b3afe3a81733a732e633317d747bfaac7` ...) | candidate · not_run · 1 readset(s) | no-eval |
| [training-resource-budget](../src/inferrsi/data/skill_library/methods/training-resource-budget/SKILL.md) | common | Choose training offload and resource-budget changes using pinned DeepSpeed configuration, attributed expert diagnosis ... | 1 Accelerator · Diagnose / Configure / Optimize<br>2 RAM/Host · Observe / Diagnose / Configure / Optimize / Verify<br>3 SSD · Configure / Optimize<br>4 Network · Observe / Diagnose / Verify<br>5 OS · Diagnose / Configure | 1 · Systems sources (CR1 / DeepSpeed ZeRO-Infinity @ `5f266e26d216a705d9c64cac88fb813ce ...)<br>1 · Systems sources (CR5 / Ascend MindSpeed adaptive memory — `core_r0.8.0`, page ...)<br>1 · Systems sources (ZeRO-Offload — [2101.06840v1](https://arxiv.org/abs/2101.06840v1))<br>2 · Methodology and corpus references (CR6 / Stas Bekman ML Engineering Open Book @ ...) | candidate · not_run · 8 readset(s) | no-eval |
| [video-diffusion-optimization](../src/inferrsi/data/skill_library/methods/video-diffusion-optimization/SKILL.md) | common | Run and verify goal-driven video diffusion optimization, backend-agnostic. Use when the user asks for latency, RTF ... | — | — | candidate · not_run · 0 readset(s) | no-SearchSpace-layer, no-Reference-Matrix-row, no-eval |
| [weight-loading-optimization](../src/inferrsi/data/skill_library/methods/weight-loading-optimization/SKILL.md) | common | Optimize the serving-level weight load path from storage to device: judge the load path on four dimensions (source ... | 1 Accelerator † guidance: Flare preparation and complete-session source contracts<br>2 RAM/Host † guidance: Flare preparation and complete-session source contracts<br>3 SSD · Observe / Profile / Diagnose / Optimize / Verify † guidance: Flare preparation and complete-session source contracts<br>4 Network · Configure / Optimize / Verify | 1 · Systems sources (Ascend/MindIE-SD @ 8481d39)<br>1 · Systems sources (NVIDIA/TensorRT-LLM @ f33e0e5fd)<br>1 · Systems sources (ascend-ai-coding/awesome-ascend-skills @ 75ec89c)<br>1 · Systems sources (foundation-model-stack/fastsafetensors @ 219e256)<br>1 · Systems sources (ggml-org/llama.cpp @ `3e390af18de1131dda27913c00511725b4274c8a` (MIT ...)<br>1 · Systems sources (mindie-agent/mindie-agent @ 6a81b41) | candidate · not_run · 3 readset(s) | no-eval |

## Registered: Workflows (6)
Expand Down Expand Up @@ -203,7 +204,7 @@ an entrypoint routes to procedures below it rather than adding one.

## Integrity checks

- Registered ids resolve to an existing `SKILL.md`: 75 of 75.
- Registered ids resolve to an existing `SKILL.md`: 76 of 76.
- Duplicate ids or paths: none; `skill_catalog` rejects them before this view is built.
- Skill links in the two matrices that do not resolve: 0.
- Registered skills without a `metadata.json` sidecar: 5.
Expand All @@ -212,10 +213,10 @@ an entrypoint routes to procedures below it rather than adding one.

| Gap | Skills |
|---|---|
| `no-SearchSpace-layer` | 14: ascend-video-diffusion-optimization, audit-fixed-workload-claim, audit-recurrent-kv-finalization, cite-check-downstream-pr, competitor-scan, draft-acceptance-issue, dwarfstar, husky, inference-benchmark-design, lily, npu-skill-factory, repository-evolution-analysis, skill-evolution-playbook, splash |
| `no-Reference-Matrix-row` | 7: ascend-video-diffusion-optimization, audit-fixed-workload-claim, cite-check-downstream-pr, claim-contract, competitor-scan, draft-acceptance-issue, rsi-evidence |
| `no-SearchSpace-layer` | 15: ascend-video-diffusion-optimization, audit-fixed-workload-claim, audit-recurrent-kv-finalization, cite-check-downstream-pr, competitor-scan, draft-acceptance-issue, dwarfstar, husky, inference-benchmark-design, lily, npu-skill-factory, repository-evolution-analysis, skill-evolution-playbook, splash, video-diffusion-optimization |
| `no-Reference-Matrix-row` | 8: ascend-video-diffusion-optimization, audit-fixed-workload-claim, cite-check-downstream-pr, claim-contract, competitor-scan, draft-acceptance-issue, rsi-evidence, video-diffusion-optimization |
| `no-sidecar` | 5: cite-check-downstream-pr, claim-contract, competitor-scan, draft-acceptance-issue, rsi-evidence |
| `no-eval` | 73: as listed in the Gaps column above |
| `no-eval` | 74: as listed in the Gaps column above |

These are inventory gaps, not defects. A workflow skill may legitimately
have no hardware resource layer; a candidate may legitimately be untested.
Expand Down
7 changes: 4 additions & 3 deletions src/inferrsi/data/repo_packs/inferrsi/knowledge/README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# InferRSI skill discovery index

Generated abstracts for all 75 registered skills in `data/skill_library/`.
Generated abstracts for all 76 registered skills in `data/skill_library/`.
Their complete procedures, references and cases ship in the same package.
`skill-index.json` maps stable skill IDs to categorized directories. The
reference and searchspace matrices
Expand All @@ -15,7 +15,7 @@ These are knowledge abstracts (`--kind knowledge`), with namespaced package
IDs distinct from explicitly selected `checkout_ref` skills. Ascend/CUDA
procedures use their corresponding backend; shared methods use `common`.

Source snapshot: [e71d0631a1c0854c9616d8ef5e174d3a1e14af4b](https://github.com/InferMatrixLab/InferRSI/tree/e71d0631a1c0854c9616d8ef5e174d3a1e14af4b/src/inferrsi/data/skill_library).
Source snapshot: [f0e87c48809601d38035960d26737e0698489165](https://github.com/InferMatrixLab/InferRSI/tree/f0e87c48809601d38035960d26737e0698489165/src/inferrsi/data/skill_library).

```bash
inferrsi knowledge search 'profiling' --repo-type inferrsi --limit 50
Expand All @@ -29,7 +29,7 @@ contain the current input paths and bytes (Git checkout filters are respected).

```bash
python tools/build_skill_index.py --source-revision <committed-source-revision>
python tools/build_skill_index.py --source-revision e71d0631a1c0854c9616d8ef5e174d3a1e14af4b --check
python tools/build_skill_index.py --source-revision f0e87c48809601d38035960d26737e0698489165 --check
```

`--check` detects missing, stale and unexpected generated records without writing.
Expand Down Expand Up @@ -110,5 +110,6 @@ References and cases ship with their owning skill, not as duplicate knowledge ab
| [torchnpu-pinned-host-memory-lifecycle](ascend/skills/torchnpu-pinned-host-memory-lifecycle.json) | ascend | candidate |
| [training-input-pipeline](common/skills/training-input-pipeline.json) | common | candidate |
| [training-resource-budget](common/skills/training-resource-budget.json) | common | candidate |
| [video-diffusion-optimization](common/skills/video-diffusion-optimization.json) | common | candidate |
| [vllm-metal](common/skills/vllm-metal.json) | common | candidate |
| [weight-loading-optimization](common/skills/weight-loading-optimization.json) | common | candidate |
Original file line number Diff line number Diff line change
Expand Up @@ -21,8 +21,8 @@
"sources": [
{
"type": "git",
"url": "https://github.com/InferMatrixLab/InferRSI/blob/e71d0631a1c0854c9616d8ef5e174d3a1e14af4b/src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/SKILL.md",
"commit": "e71d0631a1c0854c9616d8ef5e174d3a1e14af4b",
"url": "https://github.com/InferMatrixLab/InferRSI/blob/f0e87c48809601d38035960d26737e0698489165/src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/SKILL.md",
"commit": "f0e87c48809601d38035960d26737e0698489165",
"paths": [
"src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/SKILL.md",
"src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/metadata.json",
Expand All @@ -41,7 +41,7 @@
"src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/SKILL.md": "d494fc7e539cbb7388189bd7b3f04bb5c4983fdd7a82484348aad1cee7f741f2",
"src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/metadata.json": "71c68431663ed2336cccc985a354adab6b13b4cfd6123a18a5d8d53c28268509",
"src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/references/source-notes.md": "6ffbfb68cc7e04923b4fbca2a73a7555b7c3b45a6f40819bb5f3213ef05cf88d",
"src/inferrsi/data/skill_library/skill-index.json": "eaf446cb37baa90d40166119ca17cc0a434dbe3f77611423f648b0f225903f7c"
"src/inferrsi/data/skill_library/skill-index.json": "531190c468b6fb385b9b4aa71e666e8dd20d92aa5adc54bf4040f2096e3dd190"
},
"skill_metadata": {
"name": "ascend-aclgraph-capture-replay",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -23,8 +23,8 @@
"sources": [
{
"type": "git",
"url": "https://github.com/InferMatrixLab/InferRSI/blob/e71d0631a1c0854c9616d8ef5e174d3a1e14af4b/src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/SKILL.md",
"commit": "e71d0631a1c0854c9616d8ef5e174d3a1e14af4b",
"url": "https://github.com/InferMatrixLab/InferRSI/blob/f0e87c48809601d38035960d26737e0698489165/src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/SKILL.md",
"commit": "f0e87c48809601d38035960d26737e0698489165",
"paths": [
"src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/SKILL.md",
"src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/metadata.json",
Expand All @@ -41,7 +41,7 @@
"source_files": {
"src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/SKILL.md": "03829039860ece35519f2e4c339a48b5014ec25e07a2c150a3efb6a3a4e35b4a",
"src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/metadata.json": "80d80c15514919826fa72d6f6cf26b76db8accd85d21187fc239232ca454e7bf",
"src/inferrsi/data/skill_library/skill-index.json": "eaf446cb37baa90d40166119ca17cc0a434dbe3f77611423f648b0f225903f7c"
"src/inferrsi/data/skill_library/skill-index.json": "531190c468b6fb385b9b4aa71e666e8dd20d92aa5adc54bf4040f2096e3dd190"
},
"skill_metadata": {
"name": "ascend-device-health",
Expand Down
Loading
Loading