diff --git a/docs/reference-matrix.md b/docs/reference-matrix.md index 678db61f..6bea8cf9 100644 --- a/docs/reference-matrix.md +++ b/docs/reference-matrix.md @@ -55,6 +55,7 @@ Reading rules: | vllm-project/vllm @ `7f730b4cea9a66520a9200265928ebe016b48a39` (Apache-2.0) | Dot bundle-mediated; `scheduler.py` admission/budgets/preemption/deferred frees and connector `v1/base.py` contracts/consumers; concrete connector, worker, cache-manager internals, config schema and tests unread | mined — independent admission budgets and async-KV readiness → `diagnose-vllm-admission-pressure`; completion/retention/failure ownership → `audit-vllm-kv-lifetimes`; conditional proposals and unrun verification only | out-of-scope — device KV is not host RAM | out-of-scope — external-hit API establishes no physical tier | out-of-scope — connector contract is not transport implementation | out-of-scope — engine scheduling is not OS priority control | | vllm-project/vllm-ascend @ `8a8e1e05ecb64a30804c99c8f362909f9a0cb5bf` (Apache-2.0; separate runtime pin) | Dot bundle-mediated; `compilation/acl_graph.py`, pinned graph-mode guide and selected `test_acl_graph.py` cases; tests inspected by supplier, not run; caller/ENPU ordering and helpers untraced; native single-tier spec/worker, registration and DMA binding read directly ([seven-file ledger](../src/inferrsi/data/skill_library/hardware/host/host-memory-management/references/vllm-ascend-native-offload-readset.json)); external vLLM dependencies unpinned; [separate model-adapter routing](../src/inferrsi/data/skill_library/README.md#vllm-ascend-version-and-responsibility-routing) | mined — effective dispatch, caller-owned stable inputs, branch-specific replay/update order and capture-resource failures → `ascend-aclgraph-capture-replay`; separate from the older skill-doc pin | mined — normal event-query-gated CPU descriptor-pool ownership and wait/recycle distinction → [host-memory-management](../src/inferrsi/data/skill_library/hardware/host/host-memory-management/SKILL.md); source candidate, native tests not run; shared/tiering and allocator behavior excluded | out-of-scope | out-of-scope — offloader synchronization is not network evidence | out-of-scope — ACLGraph runtime supplies no new OS-control evidence; older Dockerfile/thread-env defaults remain scoped to bc8115ed | | Ascend/pytorch (TorchNPU) @ `67511c53cd4c88014f6123de7097677e60e85faa` (upstream attribution notices retained in source notes) | Dot bundle-mediated; device/host allocators and bounded copy/record-stream/config/stats/binding/test paths in linked ledgers; underlying ATen host allocator and broader capture/IPC/driver behavior unread | mined — stream-use lifetime versus ordering, HBM counters/fragmentation and feature-gated controls → `torchnpu-device-memory-lifecycle`; tests unrun | mined — owned/external pinned buffers, host-specific counters, default/expandable paths and unresolved registration-version warning → `torchnpu-pinned-host-memory-lifecycle`; tests unrun | out-of-scope | out-of-scope — H2D/D2H, registration and IPC are not network coverage | out-of-scope — no OS-priority implementation | +| Dao-AILab/causal-conv1d @ `cd81f0413cad2fc1e6f17e785ac39f59aae690cd` (BSD-3-Clause) | Bounded source distillation, 2026-10-27; 10 retained files / 119,136 bytes matched to Git blobs; forward/update wrappers, compiled gates, selected packed/state branches, CUDA build/binding paths and test intent; [readset/notice](../src/inferrsi/data/skill_library/methods/kernel-writing-guide/references/causal-conv1d-contract.md#source-ledger) | mined (narrow) — forward versus in-place update, dtype/layout/packed history, gathered state rows and circular cursors; build targets versus observed dispatch → [kernel-writing-guide](../src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md); native/integration/numerical/performance not_run; sm_89 compatibility unqualified | out-of-scope — device convolution state is not host RAM | out-of-scope — wheel retrieval is not storage optimization | out-of-scope — no transport implementation extracted | out-of-scope — request-state ownership is not OS scheduling | | mindspore-ai/akg @ `5aa15f3fe4d856eb60cd3b27447e04f5f1fb4dff` (Apache-2.0) | Earlier discovery retained; 2026-10-23 bounded AKG-MLIR CUDA Affine tiling pass/options/pipeline/driver and one static elementwise FileCheck fixture; [readset](../src/inferrsi/data/skill_library/methods/kernel-writing-guide/references/akg-affine-tail-guards.md#source-ledger) | mined (narrow) — target/option/loop gates, full point-loop bounds and guarded body placement → [kernel-writing-guide](../src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md); compiler/device execution and gains unverified; no Ascend qualification | unknown — host implementation not extracted | negative — scanned 2026-10-15, no LLM storage material (carried finding, not rescanned) | unknown — transport not extracted | negative — 2026-10-15 OS scan: identifier false-positives only (carried finding, not rescanned) | | mindie-agent/mindie-agent @ 6a81b41 | full | out-of-scope — agent tooling, not serving performance | out-of-scope | mined (narrow) — logical-vs-physical I/O + cache-flush measurement caveat → `weight-loading-optimization` | out-of-scope | out-of-scope | | hahnyuan/LLM-Viewer @ 1893e4b | full | mined — roofline model + hardware params → `performance-ceiling-analysis` (L1) | out-of-scope | out-of-scope | out-of-scope | out-of-scope | diff --git a/docs/searchspace-matrix.md b/docs/searchspace-matrix.md index 7482f44a..902677c0 100644 --- a/docs/searchspace-matrix.md +++ b/docs/searchspace-matrix.md @@ -40,6 +40,7 @@ The primary compute and HBM resource. Most current work lives here. | **Configure** | Parallelism strategy (USP/CP/TP/PP), topology-aware card-group selection | `ascend-distributed-parallel` | USP activation requirement, masking upper-bound formula, AlltoAllV workaround | MindIE-SD dit-parallel-opt @ 8481d39b (9 reference files) | 🟢 | | **Configure** | Model adapter: FP8 dequantization, KV-head replication, multimodal feature validation order | `ascend-model-adaptation` | vllm-ascend FP8/multimodal lessons; [separate runtime-wrapper route](../src/inferrsi/data/skill_library/README.md#vllm-ascend-version-and-responsibility-routing) | vllm-ascend @ bc8115ed | 🟢 | | **Optimize** | Kernel-level: Triton/CuTe/TileIR writing, kernel tuning, fusion scope analysis | `kernel-writing-guide` | Framework routing (Triton vs CuTe vs AscendC), 6 universal correctness rules, verify-before-benchmark workflow | TRT-LLM kernel-triton-writing + kernel-cute-writing @ f33e0e5f | 🟢 | +| **Diagnose / Configure / Verify** | Existing causal depthwise convolution: API/state ownership, dtype/layout/packed boundaries, gathered rows, circular cursor and build/binding evidence | [kernel-writing-guide](../src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md) | [Five forward/update decision cases](../src/inferrsi/data/skill_library/methods/kernel-writing-guide/cases/causal-conv1d-dispatch-state.md); invalid layout/state and unproved dispatch stop qualification | Dao-AILab/causal-conv1d @ cd81f0413cad2fc1e6f17e785ac39f59aae690cd; [contract/readset](../src/inferrsi/data/skill_library/methods/kernel-writing-guide/references/causal-conv1d-contract.md); source and test intent only | Candidate; native/build/binary compatibility, downstream readiness, numerics, performance and efficacy not evaluated; no new measured coverage | | **Diagnose / Configure / Verify** | AKG static CUDA Affine loop tails: effective target/option gates, full point-loop bounds and protected input/output accesses | [kernel-writing-guide](../src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md) | [Tail-guard reference](../src/inferrsi/data/skill_library/methods/kernel-writing-guide/references/akg-affine-tail-guards.md): separation precedence, non-divisible fixture and diagnostic boundary | AKG @ 5aa15f3fe4d856eb60cd3b27447e04f5f1fb4dff; source + FileCheck expectations only | Candidate; compiler/IR command, CUDA runtime and agent efficacy not run; no new measured coverage | | **Optimize** | Operator-level: staged accuracy-gated tuning campaign (code-level → scheduling → instruction-level), metric→action routing; AscendC tiling design per operator class (reduction/broadcast/elewise/matmul/conversion) | `ascend-operator-tuning`, `ascendc-tiling-design` | PyPTO frontend/swimlane/incore playbooks; fullload-vs-split, four-element tiling template, chip-generation (DAV_2201/3510) routing | awesome-ascend-skills pypto-op-perf-tune + ascendc-tiling-design @ 75ec89c | 🟢 | | **Optimize** | Casebook of past NPU optimization decisions: AI-CPU fallback, memory-bound, comm-exposed, graph-compilation, scheduling idle gaps | `ascend-optimization-casebook`, `inference-optimization-casebook` | Five bottleneck classes with symptom→diagnosis→action→evidence schema | MindIE-SD profiling-analyze + dit-perf-opt + perf-gate + dit-parallel-opt @ 8481d39b | 🟢 | diff --git a/docs/skill-coverage.md b/docs/skill-coverage.md index 521d0ea3..203354eb 100644 --- a/docs/skill-coverage.md +++ b/docs/skill-coverage.md @@ -4,7 +4,7 @@ Generated from the registry, the skill sidecars and the two maintained matrices. **Do not edit by hand**; regenerate after any registry, skill, matrix or frozen-plan change. -- Input digest: `sha256:25b6af447e0145ceb987e965515e6d48f3fbcefd56c6effb08129d0278f4616d` +- Input digest: `sha256:20625ca481a285ea88cff5a2e7cdccecd0b2a28a09eb1a43243d97d84731c444` - Regenerate: `python tools/build_skill_coverage.py` - Verify without writing: `python tools/build_skill_coverage.py --check` @@ -125,7 +125,7 @@ optimization is fully covered or that any procedure has measured benefit. | [evaluate-elastic-serving-placement](../src/inferrsi/data/skill_library/methods/evaluate-elastic-serving-placement/SKILL.md) | common | Compare migrating an LLM request between model replicas with changing its sequence-parallel execution group, including ... | 1 Accelerator · Diagnose / Configure / Optimize / Verify
2 RAM/Host · Diagnose / Configure / Optimize / Verify
4 Network · Diagnose / Configure / Optimize / Verify | 1 · Systems sources (Llumnix — [2406.03243v1](https://arxiv.org/abs/2406.03243v1)) | candidate · not_run · 1 readset(s) | no-eval | | [inference-benchmark-design](../src/inferrsi/data/skill_library/methods/inference-benchmark-design/SKILL.md) | common | Select task quality gates, reference parity checks and performance workloads for text, agentic coding, work agents ... | — | 2 · Methodology and corpus references (JiusiServe/vllm-evolve @ 43cc82c)
Task-specific benchmark selection (issue #60) ([Issue #60 report](https://github.com/InferMatrixLab/InferRSI/issues/6 ...) | candidate · not_run · 2 readset(s) | no-SearchSpace-layer | | [inference-optimization-casebook](../src/inferrsi/data/skill_library/methods/inference-optimization-casebook/SKILL.md) | common | How to structure and use a casebook of past optimization decisions as a decision-support tool. Extracts the casebook ... | 1 Accelerator · Optimize | 1 · Systems sources (NVIDIA/TensorRT-LLM @ f33e0e5fd) | candidate · not_run · 0 readset(s) | no-eval | -| [kernel-writing-guide](../src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md) | common | Decision guide for writing custom inference kernels: when to write one, which framework to choose (Triton, CuTe DSL ... | 1 Accelerator · Optimize / Diagnose / Configure / Verify | 1 · Systems sources (NVIDIA/TensorRT-LLM @ f33e0e5fd)
1 · Systems sources (mindspore-ai/akg @ `5aa15f3fe4d856eb60cd3b27447e04f5f1fb4dff` ...) | candidate · not_run · 1 readset(s) | no-eval | +| [kernel-writing-guide](../src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md) | common | Decision guide for writing custom inference kernels: when to write one, which framework to choose (Triton, CuTe DSL ... | 1 Accelerator · Optimize / Diagnose / Configure / Verify | 1 · Systems sources (Dao-AILab/causal-conv1d @ `cd81f0413cad2fc1e6f17e785ac39f59aae690cd` ...)
1 · Systems sources (NVIDIA/TensorRT-LLM @ f33e0e5fd)
1 · Systems sources (mindspore-ai/akg @ `5aa15f3fe4d856eb60cd3b27447e04f5f1fb4dff` ...) | candidate · not_run · 2 readset(s) | no-eval | | [optimization-search-policy](../src/inferrsi/data/skill_library/methods/optimization-search-policy/SKILL.md) | common | Policy for how an optimization agent should select, order, and stop optimization experiments. Covers candidate ... | 1 Accelerator · Optimize | 2 · Methodology and corpus references (JiusiServe/vllm-evolve @ 43cc82c)
2 · Methodology and corpus references (RRSI — arXiv 2609.24972v3)
2 · Methodology and corpus references (arXiv 2608.01867 (CRISP))
2 · Methodology and corpus references (microsoft/SkillOpt @ 343db22) | candidate · not_run · 6 readset(s) | no-eval | | [performance-ceiling-analysis](../src/inferrsi/data/skill_library/methods/performance-ceiling-analysis/SKILL.md) | common | Estimate optimization headroom before modifying an inference system. Produces a three-level ceiling model (analytical ... | 1 Accelerator · Diagnose / Verify
5 OS · Configure | 1 · Systems sources (NVIDIA/TensorRT-LLM @ f33e0e5fd)
1 · Systems sources (ebugger/Empirical-Roofline-Toolkit @ 0771fa9)
1 · Systems sources (hahnyuan/LLM-Viewer @ 1893e4b) | candidate · not_run · 16 readset(s) | no-eval | | [plan-activation-residency](../src/inferrsi/data/skill_library/methods/plan-activation-residency/SKILL.md) | common | Propose training activation and gradient memory reductions by distinguishing lifetime reordering, address packing and ... | 1 Accelerator · Diagnose / Optimize / Verify | 1 · Systems sources (Checkmate — [1910.02653v3](https://arxiv.org/abs/1910.02653v3)) | candidate · not_run · 1 readset(s) | no-eval | diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/README.md b/src/inferrsi/data/repo_packs/inferrsi/knowledge/README.md index 565535e0..84141f1e 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/README.md +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/README.md @@ -15,7 +15,7 @@ These are knowledge abstracts (`--kind knowledge`), with namespaced package IDs distinct from explicitly selected `checkout_ref` skills. Ascend/CUDA procedures use their corresponding backend; shared methods use `common`. -Source snapshot: [aafa181251043882546678920ae992498b405ffb](https://github.com/InferMatrixLab/InferRSI/tree/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library). +Source snapshot: [49335e0c388b84211364170daf3603525885eb28](https://github.com/InferMatrixLab/InferRSI/tree/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library). ```bash inferrsi knowledge search 'profiling' --repo-type inferrsi --limit 50 @@ -29,7 +29,7 @@ contain the current input paths and bytes (Git checkout filters are respected). ```bash python tools/build_skill_index.py --source-revision -python tools/build_skill_index.py --source-revision aafa181251043882546678920ae992498b405ffb --check +python tools/build_skill_index.py --source-revision 49335e0c388b84211364170daf3603525885eb28 --check ``` `--check` detects missing, stale and unexpected generated records without writing. diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-aclgraph-capture-replay.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-aclgraph-capture-replay.json index 00b82d33..36426db3 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-aclgraph-capture-replay.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-aclgraph-capture-replay.json @@ -21,8 +21,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-device-health.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-device-health.json index b3174d86..cb11c5e4 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-device-health.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-device-health.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-distributed-parallel.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-distributed-parallel.json index 30b9cd4b..1cc8cb6f 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-distributed-parallel.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-distributed-parallel.json @@ -24,8 +24,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/ascend/ascend-distributed-parallel/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/ascend/ascend-distributed-parallel/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-distributed-parallel/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-distributed-parallel/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-graph-mode.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-graph-mode.json index 812d7ff8..37642156 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-graph-mode.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-graph-mode.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/ascend/ascend-graph-mode/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/ascend/ascend-graph-mode/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-graph-mode/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-graph-mode/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-model-adaptation.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-model-adaptation.json index 3ccb5e9c..711581fe 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-model-adaptation.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-model-adaptation.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/ascend/ascend-model-adaptation/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/ascend/ascend-model-adaptation/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-model-adaptation/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-model-adaptation/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-profiling.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-profiling.json index d0068dd2..f85401a8 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-profiling.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-profiling.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/ascend/ascend-operator-profiling/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/ascend/ascend-operator-profiling/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-operator-profiling/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-operator-profiling/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-tuning.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-tuning.json index 6d707a35..72b56941 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-tuning.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-tuning.json @@ -24,8 +24,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/ascend/ascend-operator-tuning/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/ascend/ascend-operator-tuning/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-operator-tuning/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-operator-tuning/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-optimization-casebook.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-optimization-casebook.json index 2272a759..87ee3f02 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-optimization-casebook.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-optimization-casebook.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/ascend/ascend-optimization-casebook/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/ascend/ascend-optimization-casebook/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-optimization-casebook/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-optimization-casebook/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-performance-analysis.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-performance-analysis.json index a7723c19..54f9e053 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-performance-analysis.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-performance-analysis.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/ascend/ascend-performance-analysis/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/ascend/ascend-performance-analysis/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-performance-analysis/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-performance-analysis/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-video-diffusion-optimization.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-video-diffusion-optimization.json index 09526c83..0af776b1 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-video-diffusion-optimization.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-video-diffusion-optimization.json @@ -26,8 +26,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/ascend/ascend-video-diffusion-optimization/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/ascend/ascend-video-diffusion-optimization/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-video-diffusion-optimization/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-video-diffusion-optimization/assets/campaign.template.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascendc-tiling-design.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascendc-tiling-design.json index c84aba9d..b195e0ea 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascendc-tiling-design.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascendc-tiling-design.json @@ -24,8 +24,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/ascend/ascendc-tiling-design/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/ascend/ascendc-tiling-design/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascendc-tiling-design/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascendc-tiling-design/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/cann-attribution-overlap.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/cann-attribution-overlap.json index 56c291bd..5d98ea7e 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/cann-attribution-overlap.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/cann-attribution-overlap.json @@ -24,8 +24,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/ascend/cann-attribution-overlap/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/ascend/cann-attribution-overlap/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/cann-attribution-overlap/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/cann-attribution-overlap/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-device-memory-lifecycle.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-device-memory-lifecycle.json index b18b97e9..649ee270 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-device-memory-lifecycle.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-device-memory-lifecycle.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/ascend/torchnpu-device-memory-lifecycle/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/ascend/torchnpu-device-memory-lifecycle/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/torchnpu-device-memory-lifecycle/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/torchnpu-device-memory-lifecycle/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-pinned-host-memory-lifecycle.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-pinned-host-memory-lifecycle.json index caba8437..ed0a1a6b 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-pinned-host-memory-lifecycle.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-pinned-host-memory-lifecycle.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/ascend/torchnpu-pinned-host-memory-lifecycle/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/ascend/torchnpu-pinned-host-memory-lifecycle/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/torchnpu-pinned-host-memory-lifecycle/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/torchnpu-pinned-host-memory-lifecycle/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-serving-preemption.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-serving-preemption.json index a1378ca1..3a153c52 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-serving-preemption.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-serving-preemption.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/assess-serving-preemption/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/assess-serving-preemption/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/assess-serving-preemption/SKILL.md", "src/inferrsi/data/skill_library/methods/assess-serving-preemption/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-split-backward-schedule.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-split-backward-schedule.json index df535fdc..ee4560f3 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-split-backward-schedule.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-split-backward-schedule.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/assess-split-backward-schedule/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/assess-split-backward-schedule/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/assess-split-backward-schedule/SKILL.md", "src/inferrsi/data/skill_library/methods/assess-split-backward-schedule/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-fixed-workload-claim.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-fixed-workload-claim.json index 917c53e1..52d50d4b 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-fixed-workload-claim.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-fixed-workload-claim.json @@ -20,8 +20,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/audit-fixed-workload-claim/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/audit-fixed-workload-claim/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/audit-fixed-workload-claim/SKILL.md", "src/inferrsi/data/skill_library/methods/audit-fixed-workload-claim/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-h3-metal-fasth3-semantics.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-h3-metal-fasth3-semantics.json index b617426a..49a1886c 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-h3-metal-fasth3-semantics.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-h3-metal-fasth3-semantics.json @@ -29,8 +29,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/h3-metal/audit-h3-metal-fasth3-semantics/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/h3-metal/audit-h3-metal-fasth3-semantics/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/h3-metal/audit-h3-metal-fasth3-semantics/LICENSE", "src/inferrsi/data/skill_library/repositories/h3-metal/audit-h3-metal-fasth3-semantics/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-h3-runtime-residency.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-h3-runtime-residency.json index 68381e8f..35b1a0dc 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-h3-runtime-residency.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-h3-runtime-residency.json @@ -30,8 +30,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/h3-c/audit-h3-runtime-residency/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/h3-c/audit-h3-runtime-residency/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/h3-c/audit-h3-runtime-residency/LICENSE", "src/inferrsi/data/skill_library/repositories/h3-c/audit-h3-runtime-residency/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-llama-runtime-state.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-llama-runtime-state.json index 6571cda5..303f8ae9 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-llama-runtime-state.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-llama-runtime-state.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/llama-cpp/audit-llama-runtime-state/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/llama-cpp/audit-llama-runtime-state/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/llama-cpp/audit-llama-runtime-state/SKILL.md", "src/inferrsi/data/skill_library/repositories/llama-cpp/audit-llama-runtime-state/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-recurrent-kv-finalization.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-recurrent-kv-finalization.json index 0a149291..15bcd54c 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-recurrent-kv-finalization.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-recurrent-kv-finalization.json @@ -26,8 +26,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/vllm-rlt/audit-recurrent-kv-finalization/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/vllm-rlt/audit-recurrent-kv-finalization/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/vllm-rlt/audit-recurrent-kv-finalization/LICENSE", "src/inferrsi/data/skill_library/repositories/vllm-rlt/audit-recurrent-kv-finalization/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sd-cpp-residency.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sd-cpp-residency.json index b8d8dada..40a733c5 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sd-cpp-residency.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sd-cpp-residency.json @@ -25,8 +25,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/stable-diffusion-cpp/audit-sd-cpp-residency/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/stable-diffusion-cpp/audit-sd-cpp-residency/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/stable-diffusion-cpp/audit-sd-cpp-residency/LICENSE", "src/inferrsi/data/skill_library/repositories/stable-diffusion-cpp/audit-sd-cpp-residency/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sglang-diffusion-lifetimes.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sglang-diffusion-lifetimes.json index c3d1ea39..51ee0806 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sglang-diffusion-lifetimes.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sglang-diffusion-lifetimes.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/sglang/audit-sglang-diffusion-lifetimes/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/sglang/audit-sglang-diffusion-lifetimes/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/sglang/audit-sglang-diffusion-lifetimes/LICENSE", "src/inferrsi/data/skill_library/repositories/sglang/audit-sglang-diffusion-lifetimes/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-vllm-kv-lifetimes.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-vllm-kv-lifetimes.json index 8ae95b48..03b808de 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-vllm-kv-lifetimes.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-vllm-kv-lifetimes.json @@ -21,8 +21,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/vllm/audit-vllm-kv-lifetimes/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/vllm/audit-vllm-kv-lifetimes/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/vllm/audit-vllm-kv-lifetimes/SKILL.md", "src/inferrsi/data/skill_library/repositories/vllm/audit-vllm-kv-lifetimes/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/bound-windowed-attention-replay.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/bound-windowed-attention-replay.json index 2904ec97..3a8230ac 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/bound-windowed-attention-replay.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/bound-windowed-attention-replay.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/deepinfer/bound-windowed-attention-replay/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/deepinfer/bound-windowed-attention-replay/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/deepinfer/bound-windowed-attention-replay/SKILL.md", "src/inferrsi/data/skill_library/repositories/deepinfer/bound-windowed-attention-replay/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/budget-speculative-verification.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/budget-speculative-verification.json index 3bbc463a..4fee6e8d 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/budget-speculative-verification.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/budget-speculative-verification.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/deepinfer/budget-speculative-verification/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/deepinfer/budget-speculative-verification/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/deepinfer/budget-speculative-verification/SKILL.md", "src/inferrsi/data/skill_library/repositories/deepinfer/budget-speculative-verification/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/calibrate-serving-simulation.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/calibrate-serving-simulation.json index 7c75cd6f..d7deac21 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/calibrate-serving-simulation.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/calibrate-serving-simulation.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/calibrate-serving-simulation/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/calibrate-serving-simulation/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/calibrate-serving-simulation/SKILL.md", "src/inferrsi/data/skill_library/methods/calibrate-serving-simulation/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cgroup-resource-controls.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cgroup-resource-controls.json index b661aed2..4d841cd4 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cgroup-resource-controls.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cgroup-resource-controls.json @@ -25,8 +25,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/host/cgroup-resource-controls/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/host/cgroup-resource-controls/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/host/cgroup-resource-controls/SKILL.md", "src/inferrsi/data/skill_library/hardware/host/cgroup-resource-controls/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/checkpoint-recovery-consistency.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/checkpoint-recovery-consistency.json index be50d0b7..0d5ebd09 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/checkpoint-recovery-consistency.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/checkpoint-recovery-consistency.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/checkpoint-recovery-consistency/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/checkpoint-recovery-consistency/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/checkpoint-recovery-consistency/SKILL.md", "src/inferrsi/data/skill_library/methods/checkpoint-recovery-consistency/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/choose-parallel-training-plan.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/choose-parallel-training-plan.json index f3959543..9209d95e 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/choose-parallel-training-plan.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/choose-parallel-training-plan.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/choose-parallel-training-plan/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/choose-parallel-training-plan/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/choose-parallel-training-plan/SKILL.md", "src/inferrsi/data/skill_library/methods/choose-parallel-training-plan/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cite-check-downstream-pr.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cite-check-downstream-pr.json index 7b33b7ca..66aafe6e 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cite-check-downstream-pr.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cite-check-downstream-pr.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/workflows/cite-check-downstream-pr/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/workflows/cite-check-downstream-pr/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/skill-index.json", "src/inferrsi/data/skill_library/workflows/cite-check-downstream-pr/SKILL.md" diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/claim-contract.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/claim-contract.json index 0beb1047..dc3b33d0 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/claim-contract.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/claim-contract.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/workflows/claim-contract/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/workflows/claim-contract/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/skill-index.json", "src/inferrsi/data/skill_library/workflows/claim-contract/SKILL.md" diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/comfy-ui.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/comfy-ui.json index eb8235fd..d7566e5d 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/comfy-ui.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/comfy-ui.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/comfy-ui/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/comfy-ui/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/comfy-ui/LICENSE", "src/inferrsi/data/skill_library/repositories/comfy-ui/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/competitor-scan.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/competitor-scan.json index ebea61c4..53020e4a 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/competitor-scan.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/competitor-scan.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/workflows/competitor-scan/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/workflows/competitor-scan/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/skill-index.json", "src/inferrsi/data/skill_library/workflows/competitor-scan/SKILL.md" diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dcp-async-save-performance.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dcp-async-save-performance.json index a157b45a..c4d0cf27 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dcp-async-save-performance.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dcp-async-save-performance.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/frameworks/pytorch/dcp-async-save-performance/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/frameworks/pytorch/dcp-async-save-performance/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/frameworks/pytorch/dcp-async-save-performance/SKILL.md", "src/inferrsi/data/skill_library/frameworks/pytorch/dcp-async-save-performance/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dense-performance-evidence.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dense-performance-evidence.json index 3bf1aaf6..17921245 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dense-performance-evidence.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dense-performance-evidence.json @@ -21,8 +21,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/dense-performance-evidence/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/dense-performance-evidence/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/dense-performance-evidence/SKILL.md", "src/inferrsi/data/skill_library/methods/dense-performance-evidence/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diagnose-vllm-admission-pressure.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diagnose-vllm-admission-pressure.json index 59a7494d..3c338017 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diagnose-vllm-admission-pressure.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diagnose-vllm-admission-pressure.json @@ -21,8 +21,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/vllm/diagnose-vllm-admission-pressure/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/vllm/diagnose-vllm-admission-pressure/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/vllm/diagnose-vllm-admission-pressure/SKILL.md", "src/inferrsi/data/skill_library/repositories/vllm/diagnose-vllm-admission-pressure/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diffusers-invocation-state.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diffusers-invocation-state.json index a4935a72..d903a080 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diffusers-invocation-state.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diffusers-invocation-state.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/frameworks/diffusers/diffusers-invocation-state/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/frameworks/diffusers/diffusers-invocation-state/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/frameworks/diffusers/diffusers-invocation-state/SKILL.md", "src/inferrsi/data/skill_library/frameworks/diffusers/diffusers-invocation-state/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/draft-acceptance-issue.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/draft-acceptance-issue.json index ab0ec031..de385255 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/draft-acceptance-issue.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/draft-acceptance-issue.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/workflows/draft-acceptance-issue/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/workflows/draft-acceptance-issue/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/skill-index.json", "src/inferrsi/data/skill_library/workflows/draft-acceptance-issue/SKILL.md" diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dwarfstar.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dwarfstar.json index 03e5b3f9..7cd7bfd4 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dwarfstar.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dwarfstar.json @@ -25,8 +25,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/dwarfstar/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/dwarfstar/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/dwarfstar/LICENSE", "src/inferrsi/data/skill_library/repositories/dwarfstar/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/evaluate-elastic-serving-placement.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/evaluate-elastic-serving-placement.json index bbb8cd75..40f35a8c 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/evaluate-elastic-serving-placement.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/evaluate-elastic-serving-placement.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/evaluate-elastic-serving-placement/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/evaluate-elastic-serving-placement/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/evaluate-elastic-serving-placement/SKILL.md", "src/inferrsi/data/skill_library/methods/evaluate-elastic-serving-placement/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/generation-cache-lifecycle.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/generation-cache-lifecycle.json index ee906111..f7c5e6f1 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/generation-cache-lifecycle.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/generation-cache-lifecycle.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/mlx-lm/generation-cache-lifecycle/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/mlx-lm/generation-cache-lifecycle/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/mlx-lm/generation-cache-lifecycle/SKILL.md", "src/inferrsi/data/skill_library/repositories/mlx-lm/generation-cache-lifecycle/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-memory-management.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-memory-management.json index 7d6d95de..d1002752 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-memory-management.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-memory-management.json @@ -27,8 +27,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/host/host-memory-management/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/host/host-memory-management/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/host/host-memory-management/SKILL.md", "src/inferrsi/data/skill_library/hardware/host/host-memory-management/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-overhead-optimization.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-overhead-optimization.json index d8063395..d556f631 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-overhead-optimization.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-overhead-optimization.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/host/host-overhead-optimization/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/host/host-overhead-optimization/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/host/host-overhead-optimization/SKILL.md", "src/inferrsi/data/skill_library/hardware/host/host-overhead-optimization/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/husky.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/husky.json index b4f69249..bff76de0 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/husky.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/husky.json @@ -21,8 +21,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/husky/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/husky/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/husky/SKILL.md", "src/inferrsi/data/skill_library/repositories/husky/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-benchmark-design.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-benchmark-design.json index 1f7be96b..34d9ad1f 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-benchmark-design.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-benchmark-design.json @@ -30,8 +30,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/inference-benchmark-design/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/inference-benchmark-design/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/inference-benchmark-design/SKILL.md", "src/inferrsi/data/skill_library/methods/inference-benchmark-design/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-optimization-casebook.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-optimization-casebook.json index f420fac3..067de678 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-optimization-casebook.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-optimization-casebook.json @@ -21,8 +21,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/inference-optimization-casebook/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/inference-optimization-casebook/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/inference-optimization-casebook/SKILL.md", "src/inferrsi/data/skill_library/methods/inference-optimization-casebook/cases/admission-drain-occupancy.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kernel-writing-guide.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kernel-writing-guide.json index b56d234d..5caab6f7 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kernel-writing-guide.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kernel-writing-guide.json @@ -19,7 +19,9 @@ "accelerator", "akg", "affine", - "tail-guards" + "tail-guards", + "causal-conv1d", + "state-update" ], "origin": [ "external" @@ -27,15 +29,17 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md", + "src/inferrsi/data/skill_library/methods/kernel-writing-guide/cases/causal-conv1d-dispatch-state.md", "src/inferrsi/data/skill_library/methods/kernel-writing-guide/metadata.json", "src/inferrsi/data/skill_library/methods/kernel-writing-guide/references/akg-affine-tail-guards.md", + "src/inferrsi/data/skill_library/methods/kernel-writing-guide/references/causal-conv1d-contract.md", "src/inferrsi/data/skill_library/skill-index.json" ], - "content_sha256": "01fb1712d7eb988c5e412f02340d2e48b4f8564fcf4ab232dc5897869d0d50a0" + "content_sha256": "2a2407ca0c74226ce9b966f368cdb0d6a5c813643a60b3ec6a283bae1d04425d" } ], "index_type": "packaged-skill", @@ -44,9 +48,11 @@ }, "checkout_ref": "checkout:kernel-writing-guide", "source_files": { - "src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md": "01fb1712d7eb988c5e412f02340d2e48b4f8564fcf4ab232dc5897869d0d50a0", - "src/inferrsi/data/skill_library/methods/kernel-writing-guide/metadata.json": "0189d184337662056fc6952c7beffc1bf6154c4fa173ae3e3e463bd22d70f36c", + "src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md": "2a2407ca0c74226ce9b966f368cdb0d6a5c813643a60b3ec6a283bae1d04425d", + "src/inferrsi/data/skill_library/methods/kernel-writing-guide/cases/causal-conv1d-dispatch-state.md": "2eb67dd522021bb2234616d7f660e6ba99acb43676f48cb23141bc69bf3e0029", + "src/inferrsi/data/skill_library/methods/kernel-writing-guide/metadata.json": "39bac5c8841930f76ede18b8b260945a4ad77fef9e54d6df1afd218bd26b51f9", "src/inferrsi/data/skill_library/methods/kernel-writing-guide/references/akg-affine-tail-guards.md": "113deb2db10b171db3425bb3f1792bee763706b794c8cc2e222b4cc0d0114118", + "src/inferrsi/data/skill_library/methods/kernel-writing-guide/references/causal-conv1d-contract.md": "b3a6245cf5e9deeba0dffd4a15ddcf97da6a4315f4d3131921779438832663ad", "src/inferrsi/data/skill_library/skill-index.json": "6d5784993dc8702b2c299c2354c39f765299a6734f7c24db994a97efd3fdbed6" }, "skill_metadata": { @@ -62,7 +68,9 @@ "accelerator", "akg", "affine", - "tail-guards" + "tail-guards", + "causal-conv1d", + "state-update" ], "status": "candidate", "profile": "local-skill-v1", @@ -71,13 +79,36 @@ "origin": [ "external" ], + "sources": [ + { + "type": "git", + "url": "https://github.com/Dao-AILab/causal-conv1d", + "commit": "cd81f0413cad2fc1e6f17e785ac39f59aae690cd", + "paths": [ + "LICENSE", + "README.md", + "causal_conv1d/__init__.py", + "causal_conv1d/causal_conv1d_interface.py", + "causal_conv1d/cpp_functions.py", + "csrc/causal_conv1d.cpp", + "csrc/causal_conv1d_fwd.cu", + "csrc/causal_conv1d_update.cu", + "setup.py", + "tests/test_causal_conv1d.py" + ], + "readset": "references/causal-conv1d-contract.md", + "license": "BSD-3-Clause", + "scope": "Forward/update caller contracts, selected packed/state kernel branches and build/binding evidence; no native execution." + } + ], "empirical_validation": "not_run", "limitations": [ "Source-derived candidate; no local efficacy validation.", "Original typed source inventory is not normalized; retain source identities and limits in the procedure/readsets." ], "provenance_readsets": [ - "references/akg-affine-tail-guards.md" + "references/akg-affine-tail-guards.md", + "references/causal-conv1d-contract.md" ], "consumption_mode": "packaged" }, diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kv-tier-management.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kv-tier-management.json index 24f0490e..cb9c1235 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kv-tier-management.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kv-tier-management.json @@ -24,8 +24,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/lmcache/kv-tier-management/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/lmcache/kv-tier-management/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/lmcache/kv-tier-management/SKILL.md", "src/inferrsi/data/skill_library/repositories/lmcache/kv-tier-management/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/lazy-evaluation-stream-lifetimes.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/lazy-evaluation-stream-lifetimes.json index 36a52670..aa12ed43 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/lazy-evaluation-stream-lifetimes.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/lazy-evaluation-stream-lifetimes.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/frameworks/mlx/lazy-evaluation-stream-lifetimes/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/frameworks/mlx/lazy-evaluation-stream-lifetimes/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/frameworks/mlx/lazy-evaluation-stream-lifetimes/SKILL.md", "src/inferrsi/data/skill_library/frameworks/mlx/lazy-evaluation-stream-lifetimes/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/lily.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/lily.json index 78c851fe..ac8d46a3 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/lily.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/lily.json @@ -25,8 +25,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/lily/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/lily/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/lily/LICENSE", "src/inferrsi/data/skill_library/repositories/lily/NOTICE.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/mistral-rs.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/mistral-rs.json index 9703c680..5969402a 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/mistral-rs.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/mistral-rs.json @@ -26,8 +26,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/mistral-rs/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/mistral-rs/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/mistral-rs/LICENSE", "src/inferrsi/data/skill_library/repositories/mistral-rs/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/mlc-llm.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/mlc-llm.json index d541d969..7599ca3a 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/mlc-llm.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/mlc-llm.json @@ -27,8 +27,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/mlc-llm/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/mlc-llm/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/mlc-llm/LICENSE", "src/inferrsi/data/skill_library/repositories/mlc-llm/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/mlx-swift-lm.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/mlx-swift-lm.json index b82ba74e..908b00af 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/mlx-swift-lm.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/mlx-swift-lm.json @@ -27,8 +27,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/mlx-swift-lm/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/mlx-swift-lm/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/mlx-swift-lm/LICENSE", "src/inferrsi/data/skill_library/repositories/mlx-swift-lm/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/npu-skill-factory.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/npu-skill-factory.json index 06ea86e3..5eba003c 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/npu-skill-factory.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/npu-skill-factory.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/workflows/npu-skill-factory/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/workflows/npu-skill-factory/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/skill-index.json", "src/inferrsi/data/skill_library/workflows/npu-skill-factory/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/optimization-search-policy.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/optimization-search-policy.json index a656df28..c55d21d7 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/optimization-search-policy.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/optimization-search-policy.json @@ -21,8 +21,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/optimization-search-policy/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/optimization-search-policy/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/optimization-search-policy/SKILL.md", "src/inferrsi/data/skill_library/methods/optimization-search-policy/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/os-process-placement.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/os-process-placement.json index b140573f..9ed094b0 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/os-process-placement.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/os-process-placement.json @@ -24,8 +24,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/host/os-process-placement/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/host/os-process-placement/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/host/os-process-placement/SKILL.md", "src/inferrsi/data/skill_library/hardware/host/os-process-placement/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/performance-ceiling-analysis.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/performance-ceiling-analysis.json index 793e685d..cd10344d 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/performance-ceiling-analysis.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/performance-ceiling-analysis.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/performance-ceiling-analysis/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/performance-ceiling-analysis/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/performance-ceiling-analysis/SKILL.md", "src/inferrsi/data/skill_library/methods/performance-ceiling-analysis/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/plan-activation-residency.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/plan-activation-residency.json index ac95b422..c3a53dec 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/plan-activation-residency.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/plan-activation-residency.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/plan-activation-residency/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/plan-activation-residency/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/plan-activation-residency/SKILL.md", "src/inferrsi/data/skill_library/methods/plan-activation-residency/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/project-maya.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/project-maya.json index ad61c483..7b852998 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/project-maya.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/project-maya.json @@ -25,8 +25,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/project-maya/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/project-maya/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/project-maya/LICENSE", "src/inferrsi/data/skill_library/repositories/project-maya/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/repository-evolution-analysis.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/repository-evolution-analysis.json index b031665f..f1cc97c1 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/repository-evolution-analysis.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/repository-evolution-analysis.json @@ -21,8 +21,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/repository-evolution-analysis/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/repository-evolution-analysis/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/repository-evolution-analysis/SKILL.md", "src/inferrsi/data/skill_library/methods/repository-evolution-analysis/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/rsi-evidence.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/rsi-evidence.json index 0d27a31e..4171f5f7 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/rsi-evidence.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/rsi-evidence.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/workflows/rsi-evidence/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/workflows/rsi-evidence/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/skill-index.json", "src/inferrsi/data/skill_library/workflows/rsi-evidence/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/skill-evolution-playbook.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/skill-evolution-playbook.json index 97dd810c..4b3d8d6b 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/skill-evolution-playbook.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/skill-evolution-playbook.json @@ -21,8 +21,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/skill-evolution-playbook/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/skill-evolution-playbook/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/skill-evolution-playbook/SKILL.md", "src/inferrsi/data/skill_library/methods/skill-evolution-playbook/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/splash.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/splash.json index ff229ccb..e7ffbe6b 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/splash.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/splash.json @@ -25,8 +25,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/splash/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/splash/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/splash/LICENSE", "src/inferrsi/data/skill_library/repositories/splash/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/storage-io-measurement.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/storage-io-measurement.json index bf4693d1..0823531a 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/storage-io-measurement.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/storage-io-measurement.json @@ -24,8 +24,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/host/storage-io-measurement/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/host/storage-io-measurement/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/host/storage-io-measurement/SKILL.md", "src/inferrsi/data/skill_library/hardware/host/storage-io-measurement/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-input-pipeline.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-input-pipeline.json index 3b0a91a4..fe60ca09 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-input-pipeline.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-input-pipeline.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/training-input-pipeline/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/training-input-pipeline/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/training-input-pipeline/SKILL.md", "src/inferrsi/data/skill_library/methods/training-input-pipeline/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-resource-budget.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-resource-budget.json index e4ef8db2..2232c1b6 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-resource-budget.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-resource-budget.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/training-resource-budget/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/training-resource-budget/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/training-resource-budget/SKILL.md", "src/inferrsi/data/skill_library/methods/training-resource-budget/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/vllm-metal.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/vllm-metal.json index 4e6a6ce4..cf9a1cc4 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/vllm-metal.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/vllm-metal.json @@ -26,8 +26,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/vllm-metal/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/vllm-metal/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/vllm-metal/LICENSE", "src/inferrsi/data/skill_library/repositories/vllm-metal/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/weight-loading-optimization.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/weight-loading-optimization.json index 76ea863e..a2a93efc 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/weight-loading-optimization.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/weight-loading-optimization.json @@ -29,8 +29,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/methods/weight-loading-optimization/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/methods/weight-loading-optimization/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/methods/weight-loading-optimization/SKILL.md", "src/inferrsi/data/skill_library/methods/weight-loading-optimization/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/audit-afd-p2p-exchanges.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/audit-afd-p2p-exchanges.json index c8e4bcac..de6aa74b 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/audit-afd-p2p-exchanges.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/audit-afd-p2p-exchanges.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/afd-plugin/audit-afd-p2p-exchanges/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/afd-plugin/audit-afd-p2p-exchanges/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/afd-plugin/audit-afd-p2p-exchanges/SKILL.md", "src/inferrsi/data/skill_library/repositories/afd-plugin/audit-afd-p2p-exchanges/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/audit-flare-session-lifecycle.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/audit-flare-session-lifecycle.json index 0da0ef35..9a3f5f36 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/audit-flare-session-lifecycle.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/audit-flare-session-lifecycle.json @@ -29,8 +29,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/repositories/flare-local-inference/audit-flare-session-lifecycle/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/repositories/flare-local-inference/audit-flare-session-lifecycle/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/repositories/flare-local-inference/audit-flare-session-lifecycle/LICENSE", "src/inferrsi/data/skill_library/repositories/flare-local-inference/audit-flare-session-lifecycle/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/diagnose-attention-bottlenecks.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/diagnose-attention-bottlenecks.json index 5aed6d91..8accc394 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/diagnose-attention-bottlenecks.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/diagnose-attention-bottlenecks.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/cuda/diagnose-attention-bottlenecks/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/cuda/diagnose-attention-bottlenecks/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/cuda/diagnose-attention-bottlenecks/SKILL.md", "src/inferrsi/data/skill_library/hardware/cuda/diagnose-attention-bottlenecks/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/host-overhead-profiling.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/host-overhead-profiling.json index a41967e2..0132b132 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/host-overhead-profiling.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/host-overhead-profiling.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/cuda/host-overhead-profiling/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/cuda/host-overhead-profiling/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/cuda/host-overhead-profiling/SKILL.md", "src/inferrsi/data/skill_library/hardware/cuda/host-overhead-profiling/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/reason-hopper-kernels.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/reason-hopper-kernels.json index 7463de26..6312d4cf 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/reason-hopper-kernels.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/reason-hopper-kernels.json @@ -36,8 +36,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/aafa181251043882546678920ae992498b405ffb/src/inferrsi/data/skill_library/hardware/cuda/reason-hopper-kernels/SKILL.md", - "commit": "aafa181251043882546678920ae992498b405ffb", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/49335e0c388b84211364170daf3603525885eb28/src/inferrsi/data/skill_library/hardware/cuda/reason-hopper-kernels/SKILL.md", + "commit": "49335e0c388b84211364170daf3603525885eb28", "paths": [ "src/inferrsi/data/skill_library/hardware/cuda/reason-hopper-kernels/SKILL.md", "src/inferrsi/data/skill_library/hardware/cuda/reason-hopper-kernels/metadata.json", diff --git a/src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md b/src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md index ec87da67..0fe2740d 100644 --- a/src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md +++ b/src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md @@ -40,6 +40,16 @@ Writing a kernel is expensive. Verify the bottleneck before starting. - The bottleneck is host-side scheduling: that is a Python/GIL problem, not a kernel problem. See `host-overhead-profiling`. +## Qualify an existing causal convolution operator + +Before replacing or binding causal depthwise convolution, use the +[causal-conv1d contract](references/causal-conv1d-contract.md) to choose a +full-sequence forward call or an in-place state update. Check dtype, strides, +packed boundaries, state rows and circular-buffer cursors before substitution. +The [five decision cases](cases/causal-conv1d-dispatch-state.md) cover invalid +layouts, continuation state and unproved dispatch. Build targets and import +success do not establish the executing operator, numerical parity or a gain. + ## Framework routing | Pattern | CUDA / Ampere+ | Ascend NPU | diff --git a/src/inferrsi/data/skill_library/methods/kernel-writing-guide/cases/causal-conv1d-dispatch-state.md b/src/inferrsi/data/skill_library/methods/kernel-writing-guide/cases/causal-conv1d-dispatch-state.md new file mode 100644 index 00000000..47bb3180 --- /dev/null +++ b/src/inferrsi/data/skill_library/methods/kernel-writing-guide/cases/causal-conv1d-dispatch-state.md @@ -0,0 +1,142 @@ +# Causal convolution decision cases + +These five operational examples apply the pinned +[forward/update contract](../references/causal-conv1d-contract.md). +They specify expected decisions and evidence requests, not executed tests or +benchmark results. All dimensions are illustrative. The owner remains a +source-derived candidate with native execution and efficacy unevaluated. + +## 1. Stateless sequence versus persistent update + +**Situation.** A classifier supplies `x=(2, 16, 128)` and weight `(16, 4)`. +It has no continuation history. A serving integration exposes an update +function and asks to use it because the model family also supports decoding. + +**Decision.** Qualify `causal_conv1d_fn` for the stateless full sequence, then +check its dtype/layout/activation. Do not create a persistent cache merely to +fit the update API. For a separate continuation caller that already owns a +writable convolution state, qualify update; a two-dimensional input is expanded +to one token, while a three-dimensional update may contain multiple tokens. +An explicit chunk caller may instead pass forward's initial/final history. + +**Required observations.** Identify the concrete caller and whether it supplies +history, requests final history or mutates persistent state. A model-family +name and sequence length do not establish that choice. Keep output and state +semantics in the later numerical comparison. + +**Stop/recovery.** If the caller is unknown, retain both possible APIs as +unresolved and request its source. Do not report the serving binding as +qualified from this operator's interface alone. + +Source: contract [API choice](../references/causal-conv1d-contract.md#choose-the-api-by-state-ownership), +ledger A/B. + +## 2. Logical shape matches but forward layout fails + +**Situation.** Forward input has logical shape `(2, 10, 11)`, channel-last +strides `(110, 1, 10)`, BF16 input, FP32 weight `(10, 4)` and FP32 bias. +A proposed substitution checks only shape and supported dtype names. + +**Decision.** The mixed input/weight dtypes are allowed by the compiled entry, +and bias follows weight dtype. The selected channel-last forward path still +fails its channel/stride divisibility-by-8 requirements. The wrapper does not +automatically copy this input because channel stride is already 1. Shape and +dtype checks are insufficient. + +**Required observations.** Capture the real input strides and selected +forward layout. If the caller can use a sequence-contiguous representation, +qualify that explicit change and its copy cost independently. Initial/final +history and packed IDs still need the channel-last forward path. Update has +different layout gates and is not a drop-in escape from forward's state +semantics. A BF16 update input also requires BF16 `conv_state`, even if its +weight is FP32. + +**Stop/recovery.** Reject the current call contract before benchmarking. +Do not silently select another API or claim a layout conversion is free. + +Source: contract [dtype/layout](../references/causal-conv1d-contract.md#check-common-values-and-forward-layout), +ledger A/B/C/E. + +## 3. Packed inputs with history and a requested final state + +**Situation.** A valid channel-last forward input uses `D=16`, `W=4` and +`seq_idx=[0, 0, 1, 1, -1]` in a batch row. The caller supplies initial history +and requests `return_final_states=True`. + +**Decision.** `seq_idx` with initial history is permitted when the complete +dtype/device/shape/stride contract holds. The history applies to the first +sequence ID; the ID transition masks history from the earlier sequence, and +the negative current ID produces zero output. The requested final-state +combination is rejected by the public wrapper. + +**Required observations.** Verify CUDA int32 contiguous `(B, L)` IDs and +input-dtype CUDA history `(B, D, W - 1)` with channel stride 1. Preserve the +sequence boundary even when two adjacent sequences share a batch row. +Establish a separate supported final-state extraction path if that output is +required; this readset does not qualify the varlen extractor implementation. + +**Stop/recovery.** Do not ban all initial history with packed IDs. Do not drop +the requested final-state behavior to make the call run. Split or redesign the +caller only after its state-output contract is established. + +Source: contract [packed boundaries](../references/causal-conv1d-contract.md#preserve-packed-boundaries-and-forward-history), +ledger A/C/D/G. The tests supply assertion intent, not a local parity result. + +## 4. Gathered request rows and a circular cursor + +**Situation.** Update has `B=3`, `D=16`, `L=2`, `W=4`, state `(8, 16, 7)`, +`conv_state_indices=[5, -1, 1]` and `cache_seqlens=[13, 0, 6]`. Indices and +cursors meet the CUDA int32 `(B,)` stride contract. + +**Decision.** Input row 0 updates state row 5; input row 2 updates state row 1. +The negative selection for input row 1 produces zero output and leaves state +rows untouched for that input. Cursor values belong to input batch positions, +not to the allocated-state row numbers. For row 0, history positions are +3, 4, 5 and new values go to positions 6, 0 in the seven-slot ring. + +**Required observations.** Compare output and the complete state tensor, +including unselected rows. Verify the caller preserves valid row ownership, +nonnegative logical cursors and completion ordering. The operator does not +advance the cursor: after two accepted tokens, the caller must account for a +logical position of 15 for row 0. Reusing 13 would select the old write start. +If a row is reassigned, initialize or restore that request's history/cursor +under the actual caller's lifecycle contract. + +**Stop/recovery.** Do not infer bounds/uniqueness checking from the index +shape check, or safety for concurrent writers to the same state row. Resolve +the caller's row/cursor ownership before issuing those calls. The upstream +padding test exercises the non-circular case; the circular padding branch +above is an implementation reading, not a reproduced test result. + +Source: contract [state rows/cursors](../references/causal-conv1d-contract.md#keep-update-rows-and-cursors-attached-to-the-caller), +ledger A/B/C/E/G. Implementation and tests resolve the reversed "If None" +phrase in the update docstring. + +## 5. sm_89 build advice does not establish readiness + +**Situation.** A worker is labeled sm_89. A proposed readiness check treats +package import and an architecture environment variable as proof that causal +convolution uses the compiled operator, and treats an `F.conv1d` call as this +package's automatic fallback. + +**Decision.** The pinned build list has no explicit sm_89 entry. That fact +does not establish runtime incompatibility, nor does the variable prove an +sm_89 cubin was emitted. A downloaded wheel may have different contents from +the local source-build expectation. The binding directly calls +`causal_conv1d_cuda`; the named reference function is not its automatic +fallback. A downstream worker's fallback policy remains a separate question. + +**Required observations.** Resolve actual hardware and stack identity, the +installed extension artifact and its architecture contents, the caller's bound +forward/update function and an observation of the selected operator. A +readiness policy that fails on downstream `F.conv1d` dispatch needs that +integration's source and a concrete failure-path check. Follow with numerical +and state checks before any latency comparison. + +**Stop/recovery.** Report readiness unresolved when those observations are +missing. Do not install, compile or run an upstream example as a side effect +of reading this case. Keep source compatibility, observed dispatch, numerical +qualification and service latency as separate conclusions. + +Source: contract [build/binding/readiness](../references/causal-conv1d-contract.md#separate-build-targets-bound-operator-and-readiness), +ledger A/B/F. No hardware or service result is asserted. diff --git a/src/inferrsi/data/skill_library/methods/kernel-writing-guide/metadata.json b/src/inferrsi/data/skill_library/methods/kernel-writing-guide/metadata.json index 9470258b..5f09b663 100644 --- a/src/inferrsi/data/skill_library/methods/kernel-writing-guide/metadata.json +++ b/src/inferrsi/data/skill_library/methods/kernel-writing-guide/metadata.json @@ -9,7 +9,9 @@ "accelerator", "akg", "affine", - "tail-guards" + "tail-guards", + "causal-conv1d", + "state-update" ], "status": "candidate", "profile": "local-skill-v1", @@ -18,13 +20,36 @@ "origin": [ "external" ], + "sources": [ + { + "type": "git", + "url": "https://github.com/Dao-AILab/causal-conv1d", + "commit": "cd81f0413cad2fc1e6f17e785ac39f59aae690cd", + "paths": [ + "LICENSE", + "README.md", + "causal_conv1d/__init__.py", + "causal_conv1d/causal_conv1d_interface.py", + "causal_conv1d/cpp_functions.py", + "csrc/causal_conv1d.cpp", + "csrc/causal_conv1d_fwd.cu", + "csrc/causal_conv1d_update.cu", + "setup.py", + "tests/test_causal_conv1d.py" + ], + "readset": "references/causal-conv1d-contract.md", + "license": "BSD-3-Clause", + "scope": "Forward/update caller contracts, selected packed/state kernel branches and build/binding evidence; no native execution." + } + ], "empirical_validation": "not_run", "limitations": [ "Source-derived candidate; no local efficacy validation.", "Original typed source inventory is not normalized; retain source identities and limits in the procedure/readsets." ], "provenance_readsets": [ - "references/akg-affine-tail-guards.md" + "references/akg-affine-tail-guards.md", + "references/causal-conv1d-contract.md" ], "consumption_mode": "packaged" } diff --git a/src/inferrsi/data/skill_library/methods/kernel-writing-guide/references/causal-conv1d-contract.md b/src/inferrsi/data/skill_library/methods/kernel-writing-guide/references/causal-conv1d-contract.md new file mode 100644 index 00000000..edbc4bbd --- /dev/null +++ b/src/inferrsi/data/skill_library/methods/kernel-writing-guide/references/causal-conv1d-contract.md @@ -0,0 +1,242 @@ +# Causal convolution forward and update contract + +Status: source-derived candidate. Use this reference to qualify one causal +depthwise-convolution caller before substituting an operator or writing a kernel. +The source is [Dao-AILab/causal-conv1d](https://github.com/Dao-AILab/causal-conv1d) +at `cd81f0413cad2fc1e6f17e785ac39f59aae690cd`, package version 1.7.0, +BSD-3-Clause. Source inspection establishes the contracts below; native +correctness, binary compatibility, serving integration and performance remain +`not_run`. + +## Choose the API by state ownership + +Record the caller's input shape, dtype, strides, activation, packed-sequence +boundaries and continuation-state ownership. Use the same observations when +comparing a proposed replacement. Let `B` be call batch size, `D` channels, `L` +input sequence length, `W` convolution width, `S` update-state length and `N` +allocated state rows. + +| API | Input and output | State behavior | Decision | +|---|---|---|---| +| `causal_conv1d_fn` | `x` and output `(B, D, L)` | Optional `initial_states`; optional returned or caller-provided final-state output | Use for a full sequence or a chunk whose history is supplied explicitly | +| `causal_conv1d_update` | `(B, D)` or `(B, D, L)`; output retains that logical shape | Mutates `conv_state` in place; can gather state rows and use a circular cursor | Use when the caller owns persistent writable convolution state | + +The update wrapper adds and removes a sequence axis for a two-dimensional +input; update also accepts multiple input tokens. Sequence length alone does +not select the API. A stateless classification request does not acquire a +decode cache merely because a serving engine has an update operator. Trace +the actual model caller before choosing either API. [A, B] + +The reference functions express depthwise convolution with one weight row per +channel, causal history and optional SiLU activation. They return the input +dtype. Their presence supplies an oracle to qualify later; it does not prove +bitwise identity or any particular tolerance on a device. [A] + +## Check common values and forward layout + +| Item | Compiled forward/update contract | Wrapper distinction | +|---|---|---| +| Input and weight | CUDA tensors; each independently FP32, FP16 or BF16; weight `(D, W)`; `W` is 2, 3 or 4 | Do not invent a same-dtype requirement between input and weight | +| Bias | Optional CUDA `(D,)`, weight dtype, last stride 1 | Forward makes bias contiguous; update passes it through | +| Activation | `None`, `"silu"` or `"swish"` | Both nonempty names select the SiLU branch; other names raise `NotImplementedError` | +| Output | Same logical shape and dtype as input | Binding helpers allocate `empty_like(x)` | + +For compiled **forward**, input must have `x.stride(2) == 1` or +`x.stride(1) == 1`. The C++ entry selects channel-last precisely when +`x.stride(1) == 1 and x.stride(2) > 1`. That path additionally requires +`D % 8 == 0`, `x.stride(0) % 8 == 0` and `x.stride(2) % 8 == 0`. +The public wrapper copies `x` to contiguous storage if neither accepted axis +has stride 1. Account for that copy separately when interpreting a profile; +logical shape alone does not establish the compiled layout. [A, B, C] + +The update entry passes input and state strides to its kernel and does not +apply forward's channel-last/divisibility gates. Do not transfer those gates +to update or use update's layout behavior to qualify forward. [C, E] + +## Preserve packed boundaries and forward history + +Forward's `seq_idx` is CUDA int32 with shape `(B, L)`, contiguous at the +compiled boundary and supported only on the channel-last path. The public +wrapper makes it contiguous. For each output, the selected forward kernel +uses history only where the sequence IDs match that output's ID. A negative +current sequence ID denotes padding and produces zero output. Distinct packed +sequences must retain their boundaries when batching or reshaping. [A, C, D] + +`initial_states` and `final_states_out` each have shape `(B, D, W - 1)`, +input dtype, CUDA placement and channel stride 1. The C++ entry requires the +channel-last forward path for either state. The wrapper allocates a suitable +final-state tensor when `return_final_states=True` and none was supplied; +otherwise it discards the final-state output argument. Supplying an arbitrary +contiguous history tensor does not establish the required channel stride. [A, C] + +The public forward rejects `seq_idx` together with +`return_final_states=True`. It **permits `seq_idx` with `initial_states`**: +the initial history is associated with the first sequence ID in each batch +row, while subsequent sequence boundaries still mask older contributions. +This combination is present in the reference and selected tests. Do not +invent a blanket ban on packed inputs with initial history. To obtain packed +final states, establish a separately supported extraction/caller path; the +varlen state-extraction implementation is outside this readset. [A, C, D, G] + +## Keep update rows and cursors attached to the caller + +`conv_state` is a writable CUDA tensor in input dtype, with `S >= W - 1`. +Without `conv_state_indices`, its shape is `(B, D, S)`. With indices, its +shape is `(N, D, S)` and each input row selects one of those state rows. +`conv_state_indices` must be CUDA int32, shape `(B,)`, stride 1. The kernel +uses `conv_state_indices[b]` when present and row `b` otherwise. The interface +docstring's phrase "If None" for selecting a larger state tensor is reversed; +the C++ branch, kernel and batch-gather test establish selection **when indices +are supplied**. [A, C, E, G] + +A negative selected row produces zero output and returns before accessing or +mutating a state row. This is update padding, distinct from forward's negative +`seq_idx`. The shown C++ entry checks index shape/dtype, but does not check +positive index bounds or uniqueness. Address arithmetic therefore requires +caller-proven valid nonnegative row selections for active requests. The +readset establishes no safety for concurrent writes to the same row. Preserve +request-to-row ownership and completion ordering at the caller. [C, E] + +| Cursor | State interpretation | Caller responsibility | +|---|---|---| +| `cache_seqlens=None` | Non-circular history: retain the latest `S` values from previous history plus input | Preserve chronological state and the correct request row | +| CUDA int32 `(B,)`, stride 1 | Circular history: read the preceding `W - 1` values and write input starting at `cache_seqlens[b] % S`, wrapping at `S` | Supply the cursor for input row `b`, even when state rows are gathered; maintain logical cursor advancement outside the operator | + +The kernel reads `cache_seqlens` and mutates `conv_state`; it does not advance +the supplied cursor. Its modulo/address arithmetic requires caller-proven +nonnegative logical sequence lengths; the C++ entry does not check cursor +values. This is a source-based caller obligation, not a new runtime guard. +Reusing a stale cursor can overwrite a different part of the ring. A request +reassignment needs the correct history and cursor, not just an available row. +The binding declares `out` and `conv_state` as mutated, excluding the cursor. +[B, C, E] + +For example, with `W=4`, `S=7`, a cursor of 13 reads history positions +3, 4 and 5, then a two-token update writes positions 6 and 0. Advancing the +logical cursor to 15 is a separate caller action. This arithmetic example +illustrates the source contract; it is not an executed kernel trace. + +## Separate build targets, bound operator and readiness + +`cpp_functions.py` directly imports `causal_conv1d_cuda`. Its registered +`DaoAILab` custom operations call the compiled extension. The public +`causal_conv1d_ref` and `causal_conv1d_update_ref` are explicit reference +functions; this path does not automatically switch to them when the compiled +extension is unavailable. A downstream model may have its own import/fallback +policy, which requires that model's source and actual binding evidence. [A, B] + +In `setup.py`'s CUDA build branch, the explicit `-gencode` list contains +sm_75, sm_80 and sm_87; CUDA toolkit 11.8 or later adds sm_90, 12.8 or later +adds sm_100/sm_120, and 13.0 or later adds sm_103/sm_110/sm_121. The +toolkit check rejects versions below 11.6 when `CUDA_HOME` is present. +There is no explicit sm_89 entry in this list. This source fact neither +certifies nor rules out execution on an sm_89 device: binary contents and +runtime compatibility are separate evidence. An environment-variable recipe +alone does not prove that this build emits an sm_89 cubin. [F] + +The wheel command can retrieve a prebuilt wheel before falling back to a +source build; `CAUSAL_CONV1D_FORCE_BUILD=TRUE` bypasses that retrieval path. +Neither local build flags nor an import identify the contents of a separately +downloaded binary. `CAUSAL_CONV1D_SKIP_CUDA_BUILD` is a packaging switch, not +proof of a runnable operator. [F] + +Before a later native qualification, retain these distinct observations: + +1. Identify the actual device and compute capability, package/extension + artifact, PyTorch/CUDA stack and ABI. Resolve conflicting hardware labels + before comparing results. +2. Identify the caller's bound forward/update function, its contract and any + fallback branch. Import success establishes only that the import completed. +3. Inspect the installed binary's architecture contents and observe the + operator selected for the concrete workload. A build target list does not + prove dispatch. +4. Compare output and mutated state against an appropriate independent + reference under a frozen numerical protocol. Include packed boundaries, + padding, gathered rows and wraparound only where the caller uses them. +5. Apply the caller's explicit readiness policy, then measure the intended + boundary after correctness. A policy requiring readiness failure on a + downstream `F.conv1d` fallback belongs to that integration; it is not + implemented by this source contract. + +These observations define a later verification path. No installation recipe, +automatic dispatch code, CUDA graph contract, model-specific fallback policy, +classification latency or service improvement is qualified here. Use the +[five operational cases](../cases/causal-conv1d-dispatch-state.md) to check the +decision before requesting that evidence. + +## Source ledger + +The ten retained files total 119,136 bytes. Their exact bytes were matched to +the pinned Git tree using Git blob SHA-1 identities; retention does not mean +every body was extracted. All links use the same full source revision. + +| Key | Pinned path / inspected lines | Extracted boundary | +|---|---|---| +| A | [Interface, 10–66](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/causal_conv1d/causal_conv1d_interface.py#L10-L66), [102–261](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/causal_conv1d/causal_conv1d_interface.py#L102-L261) | Public forward/update wrappers and reference semantics; backward body excluded | +| B | [Bindings, 1–31](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/causal_conv1d/cpp_functions.py#L1-L31), [71–114](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/causal_conv1d/cpp_functions.py#L71-L114), [163–183](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/causal_conv1d/cpp_functions.py#L163-L183) | Direct compiled-extension calls, output allocation and mutation declarations | +| C | [C++ entry, 77–115](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/csrc/causal_conv1d.cpp#L77-L115), [150–258](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/csrc/causal_conv1d.cpp#L150-L258), [465–562](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/csrc/causal_conv1d.cpp#L465-L562) | Dtype/shape/layout/state/index/cursor gates and dispatch; backward excluded | +| D | [Forward kernel, 235–359](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/csrc/causal_conv1d_fwd.cu#L235-L359) | Selected initial-history, sequence-ID masking, padding and channel-last launch branches; full instruction/performance audit excluded | +| E | [Update kernel, 23–146](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/csrc/causal_conv1d_update.cu#L23-L146) | Row selection, padding early return, circular/non-circular state update and width specialization | +| F | [Build, 41–44](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/setup.py#L41-L44), [137–204](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/setup.py#L137-L204), [315–347](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/setup.py#L315-L347) | CUDA toolkit/architecture gates, build switches and wheel/source branch; setup not executed; ROCm qualification excluded | +| G | [Tests, 71–137](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/tests/test_causal_conv1d.py#L71-L137), [154–321](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/tests/test_causal_conv1d.py#L154-L321), [416–623](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/tests/test_causal_conv1d.py#L416-L623), [642–713](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/tests/test_causal_conv1d.py#L642-L713) | Forward/history, update/gather/padding and packed-sequence assertion intent; tests not run | +| Context | [README](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/README.md), [package version](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/causal_conv1d/__init__.py), [license](https://github.com/Dao-AILab/causal-conv1d/blob/cd81f0413cad2fc1e6f17e785ac39f59aae690cd/LICENSE) | Published intent, version and retained notice | + +### Exact retained file identities + +| Source path | Bytes | Git blob SHA-1 | +|---|---:|---| +| `LICENSE` | 1558 | `5860e4b33f3d9d85fc636137c559331d51783a5b` | +| `README.md` | 1086 | `1c1691f6f1e228bdbccd65fc4b1bf147bcf158f4` | +| `causal_conv1d/__init__.py` | 112 | `9a251332aa5be96e55884fc54e119bc6e9aa109b` | +| `causal_conv1d/causal_conv1d_interface.py` | 9810 | `0e7b0299ac6b320a9343c20e427ecc7d2d3826c0` | +| `causal_conv1d/cpp_functions.py` | 4609 | `af27abe87c459b76fbb99a338299148fa3a99d83` | +| `csrc/causal_conv1d.cpp` | 24830 | `02d9d85d957e2fe609c5c4b7517222ae2c496bca` | +| `csrc/causal_conv1d_fwd.cu` | 21923 | `95e34bbdfd330a58d4e161657622b680255a3b43` | +| `csrc/causal_conv1d_update.cu` | 7188 | `ccbf296a36b2794e37f830a911eb2aecb52f5a64` | +| `setup.py` | 13958 | `0bcdd8153f87461bd2051cb25c4a8db516e5e05b` | +| `tests/test_causal_conv1d.py` | 34062 | `7eb54c14a23f2313f32df394b42d9fcd6883bbc9` | + +Uncovered: backward CUDA implementation, full variable-length state extraction, +ROCm execution, CUDA compilation/import/kernel tests, binary architecture +compatibility, graph capture, request scheduling and cursor advancement in a +real caller, Transformers/vLLM/SGLang/FLA/FlashInfer integration, numerical and +quality acceptance, performance and agent efficacy. The source-derived addition +preserves the owner's candidate state and `empirical_validation=not_run`. + +## Upstream BSD notice + +The guidance paraphrases the inspected source; no upstream implementation is +vendored. The source files credit Tri Dao. The complete pinned license notice is +retained below. + +```text +BSD 3-Clause License + +Copyright (c) 2022, the respective contributors, as shown by the AUTHORS file. +All rights reserved. + +Redistribution and use in source and binary forms, with or without +modification, are permitted provided that the following conditions are met: + +* Redistributions of source code must retain the above copyright notice, this + list of conditions and the following disclaimer. + +* Redistributions in binary form must reproduce the above copyright notice, + this list of conditions and the following disclaimer in the documentation + and/or other materials provided with the distribution. + +* Neither the name of the copyright holder nor the names of its + contributors may be used to endorse or promote products derived from + this software without specific prior written permission. + +THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" +AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE +IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE +DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE +FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL +DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR +SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER +CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, +OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE +OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. +```