Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
61 commits
Select commit Hold shift + click to select a range
e087f2f
valen: serve noul and score questions through the reference worker
Oct 13, 2026
cb78ab9
valen: state the logit-count requirement in the executor error
Oct 13, 2026
2192c27
docs(valen): pin the parity records to the committed noul/score tree
Oct 13, 2026
0abc00c
docs(valen): keep the recipe to procedure and move new run records to…
Oct 14, 2026
507c448
valen: gate parity on the requested answer type and the confidence delta
Oct 14, 2026
75efa40
docs(valen): record the parity rerun with the type and confidence gates
Oct 14, 2026
4a89e1a
valen: add export merge math, downcast and checkpoint-key classification
Oct 14, 2026
239ec37
valen: stream the exported artifact set and validate its manifest
Oct 14, 2026
669c0ef
valen: enforce the artifact pins and wire the export CLI
Oct 14, 2026
2a7470a
valen: measure export parity and merge drift, fill the manifest slot
Oct 14, 2026
87b30e2
valen: document the checkpoint export and wire its recipe regression
Oct 14, 2026
2f13a9c
valen: record the export-parity verdict and drift evidence
Oct 14, 2026
7cff566
valen: stream validate_export file digests instead of reading whole f…
Oct 14, 2026
04b3883
valen: fail closed on missing checkpoint and base digest pins
Oct 14, 2026
9734a67
valen: verify base shard digests in the parity source cross-check
Oct 14, 2026
9d40782
valen: tighten the export audit edges
Oct 14, 2026
6fdae22
valen: record the failed parity verdict in export.md and refresh counts
Oct 14, 2026
c9a670e
valen: inject monkeypatch into the export reference battery
Oct 14, 2026
18d2bef
docs(valen): strip planning narrative and simplify export docs
Oct 15, 2026
594d1e1
valen: export the language LoRA separately and drop the merged path
Oct 15, 2026
99dd1a5
valen: rework the parity gate for the unmerged export
Oct 15, 2026
ab6b52e
valen: document the unmerged artifact set and record the passing pari…
Oct 15, 2026
5590613
valen: pin the exported checkpoint digest and reject dirty parity sou…
Oct 15, 2026
c198542
valen: gate the reference parity run on a clean pinned checkout
Oct 15, 2026
cb60361
valen: fix the export battery src path and the score confidence fallback
Oct 15, 2026
a34f638
docs(valen): pin the recorded counts and add the export nav entry
Oct 15, 2026
e4eb6d3
valen: stage the export atomically and gate compare_case on list lengths
Oct 18, 2026
edb77d7
Merge remote-tracking branch 'upstream/main' into model/valen-noul-score
Oct 20, 2026
c780382
valen: unpin the vision tower merger output width (N1)
Oct 20, 2026
85f3c0a
valen: load vision weights from the verified export manifest (N1)
Oct 20, 2026
fb27e03
valen: record reference vision fixtures and the native parity gate (N1)
Oct 20, 2026
82adda0
valen: record the native compiler fixtures from the pinned reference
Oct 20, 2026
ca61848
valen: add the native processing crate (wire + compiler equivalence)
Oct 20, 2026
da58319
Merge the native processing crate into spec/valen-native
Oct 20, 2026
2ec83a9
Merge PR #143 head into the text LoRA line
Oct 21, 2026
518885f
Merge remote-tracking branch 'upstream/main' into spec/valen-native
Oct 21, 2026
696cb16
Merge branch 'pr-143-head' into spec/valen-native
Oct 21, 2026
b060f8c
valen: port the vision work to the shared Qwen executor
Oct 21, 2026
556d943
valen: parse the peft default-adapter layout and validate the export …
Oct 21, 2026
2e97af0
valen: record text reference fixtures and the native parity gates (N2)
Oct 21, 2026
4c34b96
Merge the unmerged text LoRA path into spec/valen-native
Oct 21, 2026
6237f68
valen: native choice worker — execution, head, finishing, HTTP surfac…
Oct 21, 2026
a9917ed
valen: record the choice parity gate — measured, then declared (N4)
Oct 21, 2026
77584f4
valen: noul + score finishing on the native worker — variants, dispat…
Oct 21, 2026
9dc7582
valen: record the noul/score/mixed parity gates — measured, then decl…
Oct 21, 2026
0ba8b85
valen: support matrix, examples and gate documentation for all three …
Oct 21, 2026
7f7a8ec
valen: finisher float repr delegates to the shared float_repr
Oct 21, 2026
64e0178
valen: recover a poisoned engine mutex instead of failing forever
Oct 21, 2026
ec0c220
valen: accept declared answer flips per qid, not per case
Oct 21, 2026
7f5c557
valen: record the non-finite detail-selection, body-timeout and >u64 …
Oct 21, 2026
f78a67d
valen: document the native worker across the docs tree
Oct 21, 2026
8ea56bb
valen: cargo fmt across the branch (stable rustfmt 1.9.0)
Oct 21, 2026
a746883
Merge remote-tracking branch 'upstream/main' into spec/valen-native
Oct 23, 2026
8e48d2b
valen: clear the clippy gate and reformat for the CI standard
Oct 23, 2026
6d85c62
valen: re-verify all GPU parity gates at ABI 9
Oct 23, 2026
8fa3592
valen: record the live worker A/B run against the reference worker
Oct 23, 2026
6655712
valen: drop internal work-package references from docs and comments
Oct 23, 2026
30b3c7a
valen: state the 2048 norm width in the CUDA backend README
Oct 23, 2026
5011ec8
valen: fix the three parity defects the review reproduced
Oct 24, 2026
6cd5715
valen: move the wired-in test bodies and fake-CUDA helper under root …
Oct 24, 2026
0499dd5
Merge remote-tracking branch 'upstream/main' into model/valen-native-…
Oct 24, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 22 additions & 0 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion Cargo.toml
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
[workspace]
members = ["src/frontend", "src/runtime", "src/models/clm", "src/models/cua_s1/native", "src/models/qwen3_5/native", "src/models/open_jev/native", "src/models/jev_vl/native", "src/models/omnijev/native", "src/models/laya", "src/backends/cuda", "src/models/decider/native", "src/models/jemm/native"]
members = ["src/frontend", "src/runtime", "src/models/clm", "src/models/cua_s1/native", "src/models/qwen3_5/native", "src/models/open_jev/native", "src/models/jev_vl/native", "src/models/omnijev/native", "src/models/laya", "src/backends/cuda", "src/models/decider/native", "src/models/jemm/native", "src/models/valen/native"]
resolver = "3"
7 changes: 4 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -160,8 +160,9 @@ LAYA text serving uses the upstream CPU worker, the in-repository Python MPS/CPU
worker, or a native Rust/CUDA worker on Hopper. The Cua-S1 4B 0.2 `text` adapter
runs as a Python worker or as a native worker on CUDA. Open-Jev-27B-v1.1
and Open-Jev-9B run on the same native Rust/CUDA worker. Cua-S1 also has a
Python screenshot worker, Valen-Preview-0923 has a Python reference worker for
text and one-image state, CLM has a stub-encoder contract recipe, and OmniJev-4B
Python screenshot worker, Valen-Preview-0923 has a Python reference worker and
a native Rust/CUDA worker for text and one-image state, CLM has a
stub-encoder contract recipe, and OmniJev-4B
v1.1 has its checkpoint export and CPU contract, with no worker yet. D3
(Decision 3.0) has a Python reference worker that runs the checkpoint's own
pinned runtime for text, image and video state:
Expand All @@ -173,7 +174,7 @@ pinned runtime for text, image and video state:
| Cua-S1 4B 0.2 (`text` adapter) | [Python worker](recipe/cua_s1/text.md); [native worker](recipe/cua_s1/native.md), CUDA; unmerged profile validated on the cumulative A800 sm_80 build, earlier merged path on sm_89 |
| Cua-S1 4B 0.2 (`multimodal` adapter) | [Python CUDA reference](src/frontend/cua_s1.py) and [native Rust/CUDA screenshot worker](recipe/cua_s1/native_screenshot.md); one PNG/JPEG image, `choice`; scoped RTX 4090 validation |
| JEMM (Qwen3.8-27B) | [Native Rust/CUDA worker](recipe/jemm/README.md); [text and 1–4-image frozen-corpus parity on A800](src/models/jemm/README.md#validation) |
| Valen-Preview-0923 | [Python reference worker](recipe/valen/reference.md); text state or one inline PNG/JPEG image, `choice`; author-run on RTX 5060 Laptop GPU (sm_120, WSL2), owner: community |
| Valen-Preview-0923 | [Python reference worker](recipe/valen/reference.md) and [native Rust/CUDA worker](recipe/valen/native.md) on the shared Qwen3.5 backends; text state or one inline PNG/JPEG image, `choice`/`noul`/`score`; both author-run on RTX 5060 Laptop GPU (sm_120, WSL2) — the native worker's end-to-end parity gates carry declared tolerances (probability/confidence 0.1, score 0.05, head 1e-4) with one declared image near-tie flip attributed to vision-tower drift; owner: community |
| Open-Jev-27B-v1.1 | [Native Rust/CUDA worker](recipe/open_jev/native.md); eager independent text candidates; [H200 validation](recipe/open_jev/validation.md) |
| Open-Jev-9B | The same [native Rust/CUDA worker](recipe/open_jev/native.md); eager independent text candidates; [reference comparison on sm_89](recipe/open_jev/validation-9b.md) |
| autotrust/JEV-27B-VL | [Experimental Rust/CUDA worker](recipe/jev_vl/README.md); single-question text, online inline PNG/JPEG and offline-preencoded image inputs; [validation scope and limits](recipe/jev_vl/validation.md) |
Expand Down
2 changes: 2 additions & 0 deletions docs/supported-models.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,8 @@ Models that are being added are also tracked in issues labeled [new model](https
| Cua-S1 4B 0.2, `multimodal` adapter | Reference worker on Transformers and PEFT, [`src/frontend/cua_s1.py`](../src/frontend/cua_s1.py); no recipe yet | Not supported | Validated ([#17](https://github.com/ThinkFlowLab/system1-omni/pull/17), [#18](https://github.com/ThinkFlowLab/system1-omni/pull/18)) | Not supported | The state is one PNG or JPEG image; upstream's `weights.lock.json` next to the base weights |
| Cua-S1 4B 0.2, `multimodal` adapter | [Native Rust/CUDA screenshot worker](../recipe/cua_s1/native_screenshot.md) | Preparation checks only; no CPU inference | RTX 4090 / sm_89, native vision and language Graph regressions; [scoped evidence and controls](../recipe/cua_s1/native_vision_graph.md) | Not supported | Verified BF16 language export, original vision checkpoint and FP32 vision adapter, rebuilt ABI 9 CUDA library; one PNG/JPEG and `choice` |
| Valen-Preview-0923 | [Python reference worker](../recipe/valen/reference.md); text state or one inline PNG/JPEG image; `choice` questions | Not supported | Author-run on RTX 5060 Laptop (sm_120, WSL2): one text and one 2×2 PNG request; input and readout parity ≤1e-6 against reference (model outputs not compared). Owner: community. | Not supported | Python 3.12, pinned Valen source/checkpoint, Qwen3.5-2B base, BF16 CUDA |
| Valen-Preview-0923 | [Python reference worker](../recipe/valen/reference.md); text state or one inline PNG/JPEG image; `choice`, `noul`, and `score` questions | Not supported | Author-run on RTX 5060 Laptop (sm_120, WSL2): one text and one 2×2 PNG request; input and readout parity ≤1e-6 against reference (model outputs not compared); `noul`/`score` parity ≤1e-6 with exact legend and token agreement on the recipe's text fixtures. Owner: community. | Not supported | Python 3.12, pinned Valen source/checkpoint, Qwen3.5-2B base, BF16 CUDA |
| Valen-Preview-0923 | [Native Rust/CUDA worker](../recipe/valen/native.md) on the shared Qwen3.5 backends: unmerged FP32 LoRA language path, manifest-verified vision tower, CPU FP32 head | Contract tests only (compiler, finisher, HTTP surface); no CPU inference | Author-run on RTX 5060 Laptop (sm_120, WSL2): end-to-end parity vs the pinned reference for text, image, `noul`, `score` and mixed fixtures with declared tolerances (probability/confidence 0.1, score 0.05, head probe 1e-4); one image near-tie flip declared and attributed to vision-tower drift ([gates and deviations](../recipe/valen/native.md)). Owner: community. | Not supported | Compute capability 8.0 or newer, CUDA toolkit to build the shared Qwen3.5 kernels (ABI 9), the five-file export (unmerged FP32 LoRA, FP32 head, vision tower) and the Qwen3.5-2B base tokenizer |
| Open-Jev-27B-v1.1 | [Native Rust/CUDA worker](../recipe/open_jev/native.md) on the shared Qwen3.5/3.8 executor | Not supported | Validated on H200 (sm_90) for the [74 single-candidate workload](../recipe/open_jev/validation.md) | Not supported | Compute capability 8.0 or newer, CUDA toolkit to build, exported merged weights and trained head |
| Open-Jev-9B | The same [native Rust/CUDA worker](../recipe/open_jev/native.md) | Not supported | Validated on compute capability 8.9 against the reference for [253 requests](../recipe/open_jev/validation-9b.md) | Not supported | Compute capability 8.0 or newer, CUDA toolkit to build, exported merged weights and trained head |
| Decider-2B v11 | [Native Rust/CUDA worker](../recipe/decider/README.md) | Contract checks only; no CPU inference | RTX 4090 (`sm_89`) synthetic parity corpus; [limits and provenance](../recipe/decider/validation.md) | Not supported | Pinned original BF16 checkpoint; ABI 9 library and consumers rebuilt together |
Expand Down
2 changes: 2 additions & 0 deletions mkdocs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -67,6 +67,8 @@ nav:
- Cua-S1 native text worker: recipe/cua_s1/native.md
- Cua-S1 text numerical parity: docs/benchmarks/cua-s1-text-parity-20261013/README.md
- Valen reference worker: recipe/valen/reference.md
- Valen checkpoint export: recipe/valen/export.md
- Valen native worker: recipe/valen/native.md
- Cua-S1 native screenshots: recipe/cua_s1/native_screenshot.md
- Cua-S1 vision CUDA Graph: recipe/cua_s1/native_vision_graph.md
- Open-Jev native text worker: recipe/open_jev/native.md
Expand Down
10 changes: 9 additions & 1 deletion recipe/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,15 @@ For a first real decision, follow the [complete CPU walkthrough](../docs/getting
- [Cua-S1 4B 0.2 text worker](cua_s1/text.md): download the pinned weights, start
the worker and connect the Rust frontend.
- [Valen-Preview-0923 reference worker](valen/reference.md): prepare the pinned
Preview checkpoint and Qwen base, start the text-or-image `choice` worker and verify the frontend.
Preview checkpoint and Qwen base, start the text-or-image `choice`/`noul`/`score`
worker and verify the frontend.
- [Valen-Preview-0923 checkpoint export](valen/export.md): export the pinned
checkpoint and base to a manifest-described safetensors artifact set and run
the export regression.
- [Valen-Preview-0923 native worker](valen/native.md): serve the same
text-or-image `choice`/`noul`/`score` contract with the shared Qwen3.5
native backends — unmerged FP32 LoRA language path, manifest-verified vision
tower and a CPU FP32 head — with the recorded parity gates and deviations.
- [Cua-S1 4B 0.2 native text worker](cua_s1/native.md): build the CUDA library and
the Rust worker, export BF16 weights with the original FP32 adapter and start
the worker.
Expand Down
Loading
Loading