agent_simulation: sample scenarios within a run for pass@k / pass^k - #1799

Open

u9g wants to merge 14 commits into

mainfrom

jason/simulation-repeats

Commits on Sep 21, 2026

agent_simulation: repeat scenarios within a run for pass@k / pass^k
u9g
committed
a12ba1b
agent_simulation: rename repeats to samples
u9g
committed
4935fc8
agent_simulation: rename Job.attempt to sample
u9g
committed
01c4ea0
generated protobuf

github-actions[bot]
authored and
u9g
committed
9e315e1
agent_simulation: decide a scenario's verdict from a min_sample_pass_rate
u9g
committed
8124859
generated protobuf

github-actions[bot]
authored and
u9g
committed
7b82d58
agent_simulation: rename min_sample_pass_rate to pass_rate
u9g
committed
3548db5
generated protobuf

github-actions[bot]
authored and
u9g
committed
9932ea3
agent_simulation: samples and pass_rate have no unset, only 0
u9g
committed
8c63856
generated protobuf

github-actions[bot]
authored and
u9g
committed
47e5a82
agent_simulation: give samples and pass_rate explicit presence
u9g
committed
77b95f3
generated protobuf

github-actions[bot]
authored and
u9g
committed
8a9e400
agent_simulation: fold samples and pass_rate into a Sampling message
u9g
committed
c28c656
generated protobuf
github-actions[bot]
committed
34e27ae