Skip to content

[Docs] Say which stream count a reader is actually in - #12

Merged
rwkeyes merged 1 commit into
dirigo/0.2.12-verifiedfrom
docs/which-stream
Nov 13, 2026
Merged

rwkeyes merged 1 commit into
dirigo/0.2.12-verifiedfrom
docs/which-stream

Conversation

@rwkeyes

@rwkeyes rwkeyes commented Nov 13, 2026

Copy link
Copy Markdown
Owner

Problem and result

The comparison table shows 1, 2, 4 and 8 streams and never says which of those a reader will actually be. Without that
mapping the 22 % headline is abstract, and the equal result at eight streams reads as a weakness rather than as a
property of the test rig.

Related discussion

none — documentation only.

Approach

A short block under the table maps the rows to situations: one stream = one person or one agent loop, where the 22 %
applies and which is most desktop use; two to four = a few agents or tools on one box, 17 % and 11 %; eight = a queue
(batch job, evaluation harness, team), where both servers ran --batch 0 — one request at a time — so eight clients
mostly wait and the lines meet.

It also says what to do if you need concurrency: the engine takes --batch/--slots (2–8 in the usual case, or
--parallel in the Terminal), which is a different experiment from the one measured, linked to docs/BATCHING.md.

The "what it does not show" line now carries the real reason for the eight-stream tie — --batch 0, one request at a
time — instead of the vaguer "queue-bound".

Validation

Passed:

  • The configuration claim is from the files, not the prose: both 0.2.13 configs carry --batch 0.
  • The slot options are from docs/BATCHING.md ("By default Strata serves one request at a time … with parallel:
    N (the engine's --batch N, also spelled --slots N)") and docs/AI_SETUP.md (--parallel N, 1–8).
  • The percentages are unchanged (22.1 / 17.1 / 10.8 / equal).
  • Links and rendering: no broken relative link, the BATCHING.md link resolves, GitHub's Markdown API renders
    the new list.

Failed:

none observed.

Not run:

  • No multi-slot measurement. The page explicitly says the --batch 2–8 numbers would be a different experiment.

Limits

  • The mapping is about client streams against one server, which is what GuideLLM sends; a multi-slot configuration
    changes the picture and is out of scope here.

The table has rows for 1, 2, 4 and 8 streams and said nothing about
which of them happens to a person. Now, right under the table:

- one stream is one person or one agent loop - ask, read, ask again -
  and that is where the 22 % applies;
- two to four is a few agents or tools on one box, still 17 % and 11 %;
- eight is a queue (batch job, eval harness, team). Both servers ran the
  tests at --batch 0, one request at a time, which is why the two lines
  meet there; for real concurrency the engine takes --batch/--slots and
  the numbers would be a different experiment, linked to BATCHING.md.

The "what it does not show" line about eight streams now says the real
reason: the measured configuration serves one request at a time, so
multi-slot serving is untested here.
@rwkeyes
rwkeyes merged commit 1c888bd into dirigo/0.2.12-verified Nov 13, 2026
3 checks passed
@rwkeyes
rwkeyes deleted the docs/which-stream branch November 13, 2026 17:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant