Repository navigation
lanes: an external drafter's chain chances price verify rows; holds follow the grants and pay for their pass - #1381
Conversation
ashhart
left a comment
There was a problem hiding this comment.
Thanks @BlivionIaG. Its own chain/grant/hold pricing is opt-in and fine, but it inherits #1379's `timed = false` and plain-stretch issues. This stack also needs alternating A/B on current main for every family the shared lane core serves.
|
Thanks @BlivionIaG. The pricing here is the lane work we want: the window allocator taking each stream's verify rows What blocks it is its base. The branch sits on #1379, which we are not taking (see there), and it reaches into the Smaller points:
The A/B in the description ran on main |
|
Thanks again @BlivionIaG. Just checking in on this one. The pricing is the part we want (chain chances pricing the verify rows, granted_depth with its slack, copy_first, and hold_costs), but the branch still carries the shared-round guard from #1379, which we closed. Could you rebase your two commits ("an external drafter's chain chances price verify rows" and "a drafter whose hold is a pass of its own") onto current main (d33dcfc) without the guard? In practice that means dropping Guard.draftsFresh, shared_guard.zig, the guarded budget branch in engine.zig, and the "a drafted stretch starts from a grant of one" step, and keeping granted_depth, chances, confidence_floor, slack, copy_first and hold_costs, all off by default as they are now. Main has also taken #1378 and #1380 since your base, so drafted.zig and drafter.zig will need a light merge. The two smaller points from before still apply: hold_price.atDepth should interpolate between the two timed depths around |
91b0cf2 to
745fe10
Compare
|
@ashhart Addressed your latest checklist. The branch is rebuilt on
Host checks: 57/57 steps and 290/290 tests; default build 236/236 steps; formatting/whitespace pass; lean 425 on both main and the branch, zero new. The M5 report has 72 alternating throughput cells and six separate diagnostic batches, with matching tokens and explicit DSpark needs the downstream adapter, so the following are explicitly #1394 integration results on that same main. Its six pricing source files match the standalone PR byte-for-byte; throughput runs use no diagnostic logging. Rates are median aggregate tokens/s over four rotations:
“Offered” means positive budgets entering Full definitions, reproduction steps and hardware/source provenance, request-level results and hold counters. No new non-M5 device coverage, long-context, cancellation or cold-prefill-scaling qualification is claimed in this report. CI is running on the receipt head. Ready for your re-review of the standalone lane changes when available. |
|
Thanks @BlivionIaG, the two review points are fixed, and this is the lane pricing we want. Since your merge of |
|
@ashhart Ready for re-review on A stream with a fresh zero-row reservation is never offered a hold. Grant/slack bounds are applied before reserving; the padded-pass cap and
A mechanical merge alone reproduced unpaid holds in a direct public-API smoke and failed seven of the nine new behavioral regressions. With the composition, profitable holds survive, unpaid holds are rejected, and fresh zero stays zero. All nine regressions now pass, including the real engine's repeated zero-grant-to-hold transition, complete absorbed-history checks before later holds, and greedy/sampled token equality. Verification:
Composition details and reproducible scoped checks. Historical M5, long-context, cancellation and load-memory receipts retain their original provenance. The new M4 smoke does not qualify the separate DSpark 512-token no-slowdown matrix; that work remains open downstream. |
|
Follow-up before final readiness: the actual-main head |
|
Standalone #1381 is ready for re-review on The reservation composition and the additional nonlinear-observer case are fixed. Shared lanes300/300; native93 pass/3 skip, family head-cost48, draft-host11; pinned lean424/424 with zero new. The separate native API repro fails before and passes after, preserving its profitable control. Context absorption, periodic probes and existing defaults remain intact. The new actual-source M4 native smoke passes16 cells/34 oracle pairs at64tokens across code/chat,T0/T1,widths1/4/8/16, including explicitdraft:false and concurrent-vs-solo equality. It uses no external drafter and does not replace historical receipts or qualify the downstream512-token performance gate. Current-source native smoke: metadata, every oracle and measured-request hash, lifecycle{"metadata":{"scope":"pr1381-native-equality","source_revision":"b833c605a138952acb1526cc0973d2924de09915","actual_main":"b17fb507af5ec1da599c5381b6990d9067e6a965","binary_sha256":"6c28a9f29ebed65305884117b93c892270c136b33f445df78e9b3ed7912f5c5f","target_revision":"667408d494bde191c2cb9dd4f4549827816b9275","drafter_revision":"e052e5b1dd103c38cdd4f8ddc068d7dea4586f55","tokens":64,"context":4096,"label":"SMOKE, NOT PERFORMANCE QUALIFICATION","no_m5_access":true},"summary":{"scope":"Native PR1381 same-head copy/draft-disabled/solo/concurrent equality; no external drafter; not DSpark qualification","source_revision":"b833c605a138952acb1526cc0973d2924de09915","tokens":64,"cells":16,"oracles":34,"exactness_failures":0,"repetitions":1,"widths":[1,4,8,16],"temperatures":[0.0,1.0]},"oracles":[{"kind":"oracle","rep":0,"arm":"plain","prompt":"code","temperature":0.0,"seed":1234,"solo_token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","draft_false_token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","activity":{"rounds":63,"drafted":15,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"code","temperature":1.0,"seed":1234,"solo_token_sha256":"d77992fc1e97fcf7e49a80adc10b44fa94f73dd5ff4f335e3d4447c376893f52","draft_false_token_sha256":"d77992fc1e97fcf7e49a80adc10b44fa94f73dd5ff4f335e3d4447c376893f52","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"code","temperature":1.0,"seed":1235,"solo_token_sha256":"63d97cd2316324a58dc8c9d924edc3126f1c7350fc4b677970e74ab3f3d3a696","draft_false_token_sha256":"63d97cd2316324a58dc8c9d924edc3126f1c7350fc4b677970e74ab3f3d3a696","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"code","temperature":1.0,"seed":1236,"solo_token_sha256":"28d99cfde5da5281ed51ce7828c8d547c01803d6a90081fa449e79c8be1a545b","draft_false_token_sha256":"28d99cfde5da5281ed51ce7828c8d547c01803d6a90081fa449e79c8be1a545b","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"code","temperature":1.0,"seed":1237,"solo_token_sha256":"2e36b933a23a1f21fdbeb6d4ceeba498ba98e51c73113c05bff7940d383bcd89","draft_false_token_sha256":"2e36b933a23a1f21fdbeb6d4ceeba498ba98e51c73113c05bff7940d383bcd89","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"code","temperature":1.0,"seed":1238,"solo_token_sha256":"ca017c2087087faedf865dc5742396e98a60e3aacfa2f4a5b9c75d6700392b4b","draft_false_token_sha256":"ca017c2087087faedf865dc5742396e98a60e3aacfa2f4a5b9c75d6700392b4b","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"code","temperature":1.0,"seed":1239,"solo_token_sha256":"2602572819811710c29ca6d409821e1e5fc0a663b7e1779a1f5b93c15df219ea","draft_false_token_sha256":"2602572819811710c29ca6d409821e1e5fc0a663b7e1779a1f5b93c15df219ea","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"code","temperature":1.0,"seed":1240,"solo_token_sha256":"2f691ef0737e604461a67b76ff136345648644c0e5abab280890ad1692b72278","draft_false_token_sha256":"2f691ef0737e604461a67b76ff136345648644c0e5abab280890ad1692b72278","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"code","temperature":1.0,"seed":1241,"solo_token_sha256":"bc1cfeba44a2eeba7839c7590b40051a424cc6faf6e5a4a068f6b7cabb473d60","draft_false_token_sha256":"bc1cfeba44a2eeba7839c7590b40051a424cc6faf6e5a4a068f6b7cabb473d60","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"code","temperature":1.0,"seed":1242,"solo_token_sha256":"d8b786d828db7e3a96403345d8f949387a4e97cf3aa53af7ccefe11d6a3e45c6","draft_false_token_sha256":"d8b786d828db7e3a96403345d8f949387a4e97cf3aa53af7ccefe11d6a3e45c6","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"code","temperature":1.0,"seed":1243,"solo_token_sha256":"cec1a6383a3debd5b19bf99a53d0f9a5a28232e5ece21930bb83e2d79ce55333","draft_false_token_sha256":"cec1a6383a3debd5b19bf99a53d0f9a5a28232e5ece21930bb83e2d79ce55333","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"code","temperature":1.0,"seed":1244,"solo_token_sha256":"e1752bd7dc5561aaa8626a1d07063d5af9c06500869306d817085dac60c8c82b","draft_false_token_sha256":"e1752bd7dc5561aaa8626a1d07063d5af9c06500869306d817085dac60c8c82b","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"code","temperature":1.0,"seed":1245,"solo_token_sha256":"2668196312009f63668d7698bf832ae76d07d8b20bed52f8ce29006ee97340df","draft_false_token_sha256":"2668196312009f63668d7698bf832ae76d07d8b20bed52f8ce29006ee97340df","activity":{"rounds":58,"drafted":5,"accepted":5},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"code","temperature":1.0,"seed":1246,"solo_token_sha256":"bf75d6647cb0c9f5bac91efea570680412bc69ac26c06bb6969a3fa33d8e77c6","draft_false_token_sha256":"bf75d6647cb0c9f5bac91efea570680412bc69ac26c06bb6969a3fa33d8e77c6","activity":{"rounds":60,"drafted":8,"accepted":3},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"code","temperature":1.0,"seed":1247,"solo_token_sha256":"efe37ea713e00d10760d69c08fa6486885424716bba744db351e30049b643055","draft_false_token_sha256":"efe37ea713e00d10760d69c08fa6486885424716bba744db351e30049b643055","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"code","temperature":1.0,"seed":1248,"solo_token_sha256":"57d80bf987523d0dc24ba7a2f405eb603865587561643d6a65adf31e8d0efcc6","draft_false_token_sha256":"57d80bf987523d0dc24ba7a2f405eb603865587561643d6a65adf31e8d0efcc6","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"code","temperature":1.0,"seed":1249,"solo_token_sha256":"f3fd1c3161d910c16ca699eb7d6f7ee1f2288f6822090d85b672e3348e8ba604","draft_false_token_sha256":"f3fd1c3161d910c16ca699eb7d6f7ee1f2288f6822090d85b672e3348e8ba604","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"chat","temperature":0.0,"seed":1234,"solo_token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","draft_false_token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"chat","temperature":1.0,"seed":1234,"solo_token_sha256":"a7f67227edb89a24e594bcbd32ab4f8e7a08e31e1fc58fe351bd006e4aac2d13","draft_false_token_sha256":"a7f67227edb89a24e594bcbd32ab4f8e7a08e31e1fc58fe351bd006e4aac2d13","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"chat","temperature":1.0,"seed":1235,"solo_token_sha256":"d521ba487bf8aaa38134f9bd4fc31920864ef46b9dc1ebe33defd10fd5cb5d8a","draft_false_token_sha256":"d521ba487bf8aaa38134f9bd4fc31920864ef46b9dc1ebe33defd10fd5cb5d8a","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"chat","temperature":1.0,"seed":1236,"solo_token_sha256":"a01ea400d0a146be7ea4f6dab9a1212afd8bf82f811f9dbc5e5825afa12bb4db","draft_false_token_sha256":"a01ea400d0a146be7ea4f6dab9a1212afd8bf82f811f9dbc5e5825afa12bb4db","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"chat","temperature":1.0,"seed":1237,"solo_token_sha256":"9da4c78d4b97c4d08d0bd3f2c82c47db44f91f3d9d114145e4d08a4385c9f5b4","draft_false_token_sha256":"9da4c78d4b97c4d08d0bd3f2c82c47db44f91f3d9d114145e4d08a4385c9f5b4","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"chat","temperature":1.0,"seed":1238,"solo_token_sha256":"9721e67e976c997a83f024156ca40a344cf0d671e28d1ba1bc3021b8ef36aec8","draft_false_token_sha256":"9721e67e976c997a83f024156ca40a344cf0d671e28d1ba1bc3021b8ef36aec8","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"chat","temperature":1.0,"seed":1239,"solo_token_sha256":"41f243ab60a52ae9ea51a31b817da9ee2cc87dcee9a79c67028215b2d17da8dd","draft_false_token_sha256":"41f243ab60a52ae9ea51a31b817da9ee2cc87dcee9a79c67028215b2d17da8dd","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"chat","temperature":1.0,"seed":1240,"solo_token_sha256":"e1c13a681af235c5e2adb8d21cd20b34eeccd7c9a6d4a1bdb9f483f1d4ab0f7f","draft_false_token_sha256":"e1c13a681af235c5e2adb8d21cd20b34eeccd7c9a6d4a1bdb9f483f1d4ab0f7f","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"chat","temperature":1.0,"seed":1241,"solo_token_sha256":"dbc87a33360556ef612d3b81c883aa79080ad066b4b22a3dd895cc00895bcadb","draft_false_token_sha256":"dbc87a33360556ef612d3b81c883aa79080ad066b4b22a3dd895cc00895bcadb","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"chat","temperature":1.0,"seed":1242,"solo_token_sha256":"6ffd11bed7f40860ad7821e43a4768c06b45b7c07d6bd909efa1c8ac10ae6c85","draft_false_token_sha256":"6ffd11bed7f40860ad7821e43a4768c06b45b7c07d6bd909efa1c8ac10ae6c85","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"chat","temperature":1.0,"seed":1243,"solo_token_sha256":"1561136dbc2bfbc02a387294b6ad764ad0e114c3e59318d7f55401a8892405f2","draft_false_token_sha256":"1561136dbc2bfbc02a387294b6ad764ad0e114c3e59318d7f55401a8892405f2","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"chat","temperature":1.0,"seed":1244,"solo_token_sha256":"bf3add938b99ad9c1d40ba1fd64dc8ee30dea953238455301fbed011748d4062","draft_false_token_sha256":"bf3add938b99ad9c1d40ba1fd64dc8ee30dea953238455301fbed011748d4062","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"chat","temperature":1.0,"seed":1245,"solo_token_sha256":"eb04192c8cffe71296cbed216c2cdfd85745dc43201ee7b8e2a6a8832bcd282f","draft_false_token_sha256":"eb04192c8cffe71296cbed216c2cdfd85745dc43201ee7b8e2a6a8832bcd282f","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"chat","temperature":1.0,"seed":1246,"solo_token_sha256":"be506e3288bcf9fb82b38c90c27bbc4028cf0b7f6d6ec7e40d4916afc892d8f0","draft_false_token_sha256":"be506e3288bcf9fb82b38c90c27bbc4028cf0b7f6d6ec7e40d4916afc892d8f0","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"chat","temperature":1.0,"seed":1247,"solo_token_sha256":"28c3dd7839add489d9695aa8f2cc8d49f550dff352989558e4976e495eeec499","draft_false_token_sha256":"28c3dd7839add489d9695aa8f2cc8d49f550dff352989558e4976e495eeec499","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"chat","temperature":1.0,"seed":1248,"solo_token_sha256":"91a7a389b8a37f7af7dab9ddac4db3bb60297d9cb74996793a2c050a60be4b13","draft_false_token_sha256":"91a7a389b8a37f7af7dab9ddac4db3bb60297d9cb74996793a2c050a60be4b13","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true},{"kind":"oracle","rep":0,"arm":"plain","prompt":"chat","temperature":1.0,"seed":1249,"solo_token_sha256":"daf4e08042d8d3da42fe1cc5b7a3e2b41e595764c5189125be6bf894077d4450","draft_false_token_sha256":"daf4e08042d8d3da42fe1cc5b7a3e2b41e595764c5189125be6bf894077d4450","activity":{"rounds":63,"drafted":0,"accepted":0},"failures":[],"ok":true}],"cells":[{"prompt":"code","temperature":0.0,"streams":1,"tokens":64,"requests":[{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"}],"failures":[],"ok":true},{"prompt":"code","temperature":0.0,"streams":4,"tokens":64,"requests":[{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"}],"failures":[],"ok":true},{"prompt":"code","temperature":0.0,"streams":8,"tokens":64,"requests":[{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"}],"failures":[],"ok":true},{"prompt":"code","temperature":0.0,"streams":16,"tokens":64,"requests":[{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f4703afc84db904cdc537b5824699afc179c7360c2df654fdd127d833b9e49ab","output_sha256":"2c08095f07eb56d8b5eb49130251817dca7af38e201e871bcb3d3fbc5af44656"}],"failures":[],"ok":true},{"prompt":"code","temperature":1.0,"streams":1,"tokens":64,"requests":[{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"d77992fc1e97fcf7e49a80adc10b44fa94f73dd5ff4f335e3d4447c376893f52","output_sha256":"fc88d34fffb2c0271add14a6dca1d70080729122a4f58a7ab0222fd83eddeec0"}],"failures":[],"ok":true},{"prompt":"code","temperature":1.0,"streams":4,"tokens":64,"requests":[{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"d77992fc1e97fcf7e49a80adc10b44fa94f73dd5ff4f335e3d4447c376893f52","output_sha256":"fc88d34fffb2c0271add14a6dca1d70080729122a4f58a7ab0222fd83eddeec0"},{"seed":1235,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"63d97cd2316324a58dc8c9d924edc3126f1c7350fc4b677970e74ab3f3d3a696","output_sha256":"aaaefd842ef055e9497af7c45c245bf077fe07da36e6e781f80b44ea669fa12d"},{"seed":1236,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"28d99cfde5da5281ed51ce7828c8d547c01803d6a90081fa449e79c8be1a545b","output_sha256":"ea30386fa9b9fd98d0920893ad2613f53b368bc21fdabc72787f63507529c497"},{"seed":1237,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"2e36b933a23a1f21fdbeb6d4ceeba498ba98e51c73113c05bff7940d383bcd89","output_sha256":"52f85f1f7f45108f79b77359313c2b088b8bfbdb727506ffa65aa861dbd12195"}],"failures":[],"ok":true},{"prompt":"code","temperature":1.0,"streams":8,"tokens":64,"requests":[{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"d77992fc1e97fcf7e49a80adc10b44fa94f73dd5ff4f335e3d4447c376893f52","output_sha256":"fc88d34fffb2c0271add14a6dca1d70080729122a4f58a7ab0222fd83eddeec0"},{"seed":1235,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"63d97cd2316324a58dc8c9d924edc3126f1c7350fc4b677970e74ab3f3d3a696","output_sha256":"aaaefd842ef055e9497af7c45c245bf077fe07da36e6e781f80b44ea669fa12d"},{"seed":1236,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"28d99cfde5da5281ed51ce7828c8d547c01803d6a90081fa449e79c8be1a545b","output_sha256":"ea30386fa9b9fd98d0920893ad2613f53b368bc21fdabc72787f63507529c497"},{"seed":1237,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"2e36b933a23a1f21fdbeb6d4ceeba498ba98e51c73113c05bff7940d383bcd89","output_sha256":"52f85f1f7f45108f79b77359313c2b088b8bfbdb727506ffa65aa861dbd12195"},{"seed":1238,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"ca017c2087087faedf865dc5742396e98a60e3aacfa2f4a5b9c75d6700392b4b","output_sha256":"a502057fedbee8127430a7bdd51901755ea39530805235b67c643c8da138d341"},{"seed":1239,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"2602572819811710c29ca6d409821e1e5fc0a663b7e1779a1f5b93c15df219ea","output_sha256":"9819dcdd76d72721a18627ec412f1faeba674775de62577edc8d787cd4f8dd71"},{"seed":1240,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"2f691ef0737e604461a67b76ff136345648644c0e5abab280890ad1692b72278","output_sha256":"f3d4e7e289b09cffe8c8b62bd47f40e216eaefd7cbb4efb6a12511633e98619d"},{"seed":1241,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"bc1cfeba44a2eeba7839c7590b40051a424cc6faf6e5a4a068f6b7cabb473d60","output_sha256":"bf19692ab5c0f03466847ef7b0939ba732d2af1ffc111268ba451c1e46fc1a64"}],"failures":[],"ok":true},{"prompt":"code","temperature":1.0,"streams":16,"tokens":64,"requests":[{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"d77992fc1e97fcf7e49a80adc10b44fa94f73dd5ff4f335e3d4447c376893f52","output_sha256":"fc88d34fffb2c0271add14a6dca1d70080729122a4f58a7ab0222fd83eddeec0"},{"seed":1235,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"63d97cd2316324a58dc8c9d924edc3126f1c7350fc4b677970e74ab3f3d3a696","output_sha256":"aaaefd842ef055e9497af7c45c245bf077fe07da36e6e781f80b44ea669fa12d"},{"seed":1236,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"28d99cfde5da5281ed51ce7828c8d547c01803d6a90081fa449e79c8be1a545b","output_sha256":"ea30386fa9b9fd98d0920893ad2613f53b368bc21fdabc72787f63507529c497"},{"seed":1237,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"2e36b933a23a1f21fdbeb6d4ceeba498ba98e51c73113c05bff7940d383bcd89","output_sha256":"52f85f1f7f45108f79b77359313c2b088b8bfbdb727506ffa65aa861dbd12195"},{"seed":1238,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"ca017c2087087faedf865dc5742396e98a60e3aacfa2f4a5b9c75d6700392b4b","output_sha256":"a502057fedbee8127430a7bdd51901755ea39530805235b67c643c8da138d341"},{"seed":1239,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"2602572819811710c29ca6d409821e1e5fc0a663b7e1779a1f5b93c15df219ea","output_sha256":"9819dcdd76d72721a18627ec412f1faeba674775de62577edc8d787cd4f8dd71"},{"seed":1240,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"2f691ef0737e604461a67b76ff136345648644c0e5abab280890ad1692b72278","output_sha256":"f3d4e7e289b09cffe8c8b62bd47f40e216eaefd7cbb4efb6a12511633e98619d"},{"seed":1241,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"bc1cfeba44a2eeba7839c7590b40051a424cc6faf6e5a4a068f6b7cabb473d60","output_sha256":"bf19692ab5c0f03466847ef7b0939ba732d2af1ffc111268ba451c1e46fc1a64"},{"seed":1242,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"d8b786d828db7e3a96403345d8f949387a4e97cf3aa53af7ccefe11d6a3e45c6","output_sha256":"80f35d698935f2fb7a9d7e037ca114363e638d826134cc55fd0eb40804e061c8"},{"seed":1243,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"cec1a6383a3debd5b19bf99a53d0f9a5a28232e5ece21930bb83e2d79ce55333","output_sha256":"afa0f5f89d6d0e92308e7ccff97be616b7f425ad994744293977d2b51de22d09"},{"seed":1244,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"e1752bd7dc5561aaa8626a1d07063d5af9c06500869306d817085dac60c8c82b","output_sha256":"d8ea1b9a113aa9c878c2ac5d4a6e5a35a6881b81d9b60f2f9a79a5bfdb59d193"},{"seed":1245,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"2668196312009f63668d7698bf832ae76d07d8b20bed52f8ce29006ee97340df","output_sha256":"7a3ba77d2c067a6da281bf2fdaeaaf63e066d619d654103c2fd7c5da945c4029"},{"seed":1246,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"bf75d6647cb0c9f5bac91efea570680412bc69ac26c06bb6969a3fa33d8e77c6","output_sha256":"0cafe66c53a439269e71c11dc74511c4253f024edc3d4c0b8ecb288596596cf1"},{"seed":1247,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"efe37ea713e00d10760d69c08fa6486885424716bba744db351e30049b643055","output_sha256":"f1bbcd88652d6ace62f20fa70ea04e13e5778f72f2fdb2e7b99f0599923e9726"},{"seed":1248,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"57d80bf987523d0dc24ba7a2f405eb603865587561643d6a65adf31e8d0efcc6","output_sha256":"c294141b3d353b579179db597adcbc16ac96aee05aad701987402ee6a36d5f23"},{"seed":1249,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"f3fd1c3161d910c16ca699eb7d6f7ee1f2288f6822090d85b672e3348e8ba604","output_sha256":"7c1b9ba533ea317a39714e6099b05d2706029fe55d067c1d6a1aec8946c4f6c9"}],"failures":[],"ok":true},{"prompt":"chat","temperature":0.0,"streams":1,"tokens":64,"requests":[{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"}],"failures":[],"ok":true},{"prompt":"chat","temperature":0.0,"streams":4,"tokens":64,"requests":[{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"}],"failures":[],"ok":true},{"prompt":"chat","temperature":0.0,"streams":8,"tokens":64,"requests":[{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"}],"failures":[],"ok":true},{"prompt":"chat","temperature":0.0,"streams":16,"tokens":64,"requests":[{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"},{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"5bf28232030fe2c057df524a9cf7d076531e17182b069b95eb522eb1aa701b0a","output_sha256":"26b700f66721be28cba310ccd5d7cf056463bbddc9d348888a4ed39a7ecf4156"}],"failures":[],"ok":true},{"prompt":"chat","temperature":1.0,"streams":1,"tokens":64,"requests":[{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"a7f67227edb89a24e594bcbd32ab4f8e7a08e31e1fc58fe351bd006e4aac2d13","output_sha256":"dfa18e6df2be30d909bd4d88293854be91ed8d92abecab30773e5dce7210c197"}],"failures":[],"ok":true},{"prompt":"chat","temperature":1.0,"streams":4,"tokens":64,"requests":[{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"a7f67227edb89a24e594bcbd32ab4f8e7a08e31e1fc58fe351bd006e4aac2d13","output_sha256":"dfa18e6df2be30d909bd4d88293854be91ed8d92abecab30773e5dce7210c197"},{"seed":1235,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"d521ba487bf8aaa38134f9bd4fc31920864ef46b9dc1ebe33defd10fd5cb5d8a","output_sha256":"6f36c5d3e35bc5f4f36e8fb7251889f6099967d6c1b15e47c32bdf25f298616d"},{"seed":1236,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"a01ea400d0a146be7ea4f6dab9a1212afd8bf82f811f9dbc5e5825afa12bb4db","output_sha256":"05bbb6d9f08d3998955c8fb9f12680ee6e25f44e54febedb26a4058ae77f81d6"},{"seed":1237,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"9da4c78d4b97c4d08d0bd3f2c82c47db44f91f3d9d114145e4d08a4385c9f5b4","output_sha256":"b8cb19b7ccaa1cd573c203a81a71026688beed3a6abf565614f9a1157ed81d0b"}],"failures":[],"ok":true},{"prompt":"chat","temperature":1.0,"streams":8,"tokens":64,"requests":[{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"a7f67227edb89a24e594bcbd32ab4f8e7a08e31e1fc58fe351bd006e4aac2d13","output_sha256":"dfa18e6df2be30d909bd4d88293854be91ed8d92abecab30773e5dce7210c197"},{"seed":1235,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"d521ba487bf8aaa38134f9bd4fc31920864ef46b9dc1ebe33defd10fd5cb5d8a","output_sha256":"6f36c5d3e35bc5f4f36e8fb7251889f6099967d6c1b15e47c32bdf25f298616d"},{"seed":1236,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"a01ea400d0a146be7ea4f6dab9a1212afd8bf82f811f9dbc5e5825afa12bb4db","output_sha256":"05bbb6d9f08d3998955c8fb9f12680ee6e25f44e54febedb26a4058ae77f81d6"},{"seed":1237,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"9da4c78d4b97c4d08d0bd3f2c82c47db44f91f3d9d114145e4d08a4385c9f5b4","output_sha256":"b8cb19b7ccaa1cd573c203a81a71026688beed3a6abf565614f9a1157ed81d0b"},{"seed":1238,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"9721e67e976c997a83f024156ca40a344cf0d671e28d1ba1bc3021b8ef36aec8","output_sha256":"046d33e3d76a365f77022d23367ba2ea7584f74f00faba4ddd2352b0231d228d"},{"seed":1239,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"41f243ab60a52ae9ea51a31b817da9ee2cc87dcee9a79c67028215b2d17da8dd","output_sha256":"60ad05895bcedec6d8c8a88e47727f9c57a82b96b4929528b6834b131ab745e6"},{"seed":1240,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"e1c13a681af235c5e2adb8d21cd20b34eeccd7c9a6d4a1bdb9f483f1d4ab0f7f","output_sha256":"cc8bb165bff5dba3a9edd03f2df3afd086f1a9c80f53ac2c898c7a0626a34a7b"},{"seed":1241,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"dbc87a33360556ef612d3b81c883aa79080ad066b4b22a3dd895cc00895bcadb","output_sha256":"03ed14ce7d9ed4d4a8038d38fad52926ab11181157487a973007864176f6b418"}],"failures":[],"ok":true},{"prompt":"chat","temperature":1.0,"streams":16,"tokens":64,"requests":[{"seed":1234,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"a7f67227edb89a24e594bcbd32ab4f8e7a08e31e1fc58fe351bd006e4aac2d13","output_sha256":"dfa18e6df2be30d909bd4d88293854be91ed8d92abecab30773e5dce7210c197"},{"seed":1235,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"d521ba487bf8aaa38134f9bd4fc31920864ef46b9dc1ebe33defd10fd5cb5d8a","output_sha256":"6f36c5d3e35bc5f4f36e8fb7251889f6099967d6c1b15e47c32bdf25f298616d"},{"seed":1236,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"a01ea400d0a146be7ea4f6dab9a1212afd8bf82f811f9dbc5e5825afa12bb4db","output_sha256":"05bbb6d9f08d3998955c8fb9f12680ee6e25f44e54febedb26a4058ae77f81d6"},{"seed":1237,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"9da4c78d4b97c4d08d0bd3f2c82c47db44f91f3d9d114145e4d08a4385c9f5b4","output_sha256":"b8cb19b7ccaa1cd573c203a81a71026688beed3a6abf565614f9a1157ed81d0b"},{"seed":1238,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"9721e67e976c997a83f024156ca40a344cf0d671e28d1ba1bc3021b8ef36aec8","output_sha256":"046d33e3d76a365f77022d23367ba2ea7584f74f00faba4ddd2352b0231d228d"},{"seed":1239,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"41f243ab60a52ae9ea51a31b817da9ee2cc87dcee9a79c67028215b2d17da8dd","output_sha256":"60ad05895bcedec6d8c8a88e47727f9c57a82b96b4929528b6834b131ab745e6"},{"seed":1240,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"e1c13a681af235c5e2adb8d21cd20b34eeccd7c9a6d4a1bdb9f483f1d4ab0f7f","output_sha256":"cc8bb165bff5dba3a9edd03f2df3afd086f1a9c80f53ac2c898c7a0626a34a7b"},{"seed":1241,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"dbc87a33360556ef612d3b81c883aa79080ad066b4b22a3dd895cc00895bcadb","output_sha256":"03ed14ce7d9ed4d4a8038d38fad52926ab11181157487a973007864176f6b418"},{"seed":1242,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"6ffd11bed7f40860ad7821e43a4768c06b45b7c07d6bd909efa1c8ac10ae6c85","output_sha256":"3219c7c329cdfc2e1dc711f81636ee4ac13499fde8909bb9ce754165435f65d6"},{"seed":1243,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"1561136dbc2bfbc02a387294b6ad764ad0e114c3e59318d7f55401a8892405f2","output_sha256":"bd7c2af342a6ce4f40e9720fb2bd60573473e754aecf312e79a9e0e16c1deaf6"},{"seed":1244,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"bf3add938b99ad9c1d40ba1fd64dc8ee30dea953238455301fbed011748d4062","output_sha256":"cd0ee7c9b750a699e110f256fcde99d277256ab2f731b6024f321b9f88ef0946"},{"seed":1245,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"eb04192c8cffe71296cbed216c2cdfd85745dc43201ee7b8e2a6a8832bcd282f","output_sha256":"46a7af4eb2031fafd51d838878156c47edc6171003a494e8b38f9561d6fbf3d5"},{"seed":1246,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"be506e3288bcf9fb82b38c90c27bbc4028cf0b7f6d6ec7e40d4916afc892d8f0","output_sha256":"850891eacca73afb69ca2079aeea93119017488aeba41e29bf3d5d2f700699cc"},{"seed":1247,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"28c3dd7839add489d9695aa8f2cc8d49f550dff352989558e4976e495eeec499","output_sha256":"1ca8fa5fda205083c5fd832b3d3d2d17d1d935d88c31faaa177f88c006fd5605"},{"seed":1248,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"91a7a389b8a37f7af7dab9ddac4db3bb60297d9cb74996793a2c050a60be4b13","output_sha256":"0c9869a9febaeea1c8f1be70fd14023ca67222fd725d1a4699cda8924de607a8"},{"seed":1249,"tokens":64,"complete":true,"error":null,"unmeasured":null,"token_sha256":"daf4e08042d8d3da42fe1cc5b7a3e2b41e595764c5189125be6bf894077d4450","output_sha256":"c3539cbe9fb02d608bbcde5f7fc10223f356eff2412a7f55fd83676694b11a69"}],"failures":[],"ok":true}],"lifecycle":[{"event":"ready","at":"2026-11-01T04:53:43Z","label":"pricing-actual-main","arm":"plain","seconds":5.1,"flags":[],"dspark_mode":null,"binary_sha256":"6c28a9f29ebed65305884117b93c892270c136b33f445df78e9b3ed7912f5c5f","dspark_weights_mib":null},{"event":"shutdown","at":"2026-11-01T04:55:18Z","label":"pricing-actual-main","forced_kill":false,"seconds":0.4,"returncode":0}]} |
…ollow the grants and pay for their pass Opt-in (granted_depth, chances, confidence_floor, slack, copy_first, hold_costs): the last verified grant bounds the next hold, the drafter's own chain chances price its verify rows, and measured hold costs filter positive shared-row reservations. A stream with a fresh zero-row reservation is never offered a hold. Defaults unchanged. Squashed from ashhart#1381's history-preserving branch at 8fcaca5, merged with main.
b833c60 to
94e7375
Compare
…ollow the grants and pay for their pass Opt-in (granted_depth, chances, confidence_floor, slack, copy_first, hold_costs): the last verified grant bounds the next hold, the drafter's own chain chances price its verify rows, and measured hold costs filter positive shared-row reservations. A stream with a fresh zero-row reservation is never offered a hold. Defaults unchanged. Squashed from #1381's history-preserving branch at 8fcaca5, merged with main.
|
Thank you @BlivionIaG. This is merged into main with your commits under your own name, so you're listed as a TensorFold contributor. It ships in the next release, credited to you in the changelog and the release notes. |
|
Thanks @BlivionIaG! The opt-in lane pricing from an external drafter's own chain chances is in 1.2.1: https://github.com/ashhart/TensorFold/releases/tag/v1.2.1 |
Scope and reservation composition
Opt-in external-drafter chain pricing, addressing the maintainer request and #1621:
propose=false, preserving later holds. Copy lookup occurs once per reservation decision and probes advance once per round.limit_shared_draftskeeps main's legacy limits. Opt-ingranted_depthgets its own bounds even when legacy limiting is disabled for chance/confidence heads. Original verified grant fields are not replaced by reservations.The rejected #1379/#1382 guards remain absent. No stream-count cutoff, new feature flag, changed feature default, family adapter change or GPU kernel change is introduced here.
Verification on the frozen code
UnpaidHoldbefore and pass after; unpaid holds are suppressed and a profitable control remains. Exact native output/source identities.draft:false, solo and concurrent token hashes agree; graceful exit0. This is functional smoke, not the 512-token DSpark matrix. Binary SHA-256:6c28a9f29ebed65305884117b93c892270c136b33f445df78e9b3ed7912f5c5f.Reservation composition and observer explanation.
Historical evidence and downstream gate
Existing M5, long-context, cancellation and load-memory receipts retain their original source/device scope. Older
cb036e00f/ac9b86869comparative smokes are not relabeled as runs of this head. No new M5 measurement was made here.The new maintainer M5 rerun still fails every4-/8-stream cell on its stated DSpark candidate. The downstream chain remains blocked on the full same-head no-drafter/BF16/8-bit, code/chat, greedy/sampled, 1/4/8/16-stream, 512-token matrix with token equality and no slowdown. No older “1–2% tradeoff” exception is claimed.
Part of #1374. No PR merge or force-push was performed.