Repository navigation

Make the metrics suite complete and usable from one object - #79

Open

mkeeler43 wants to merge 18 commits into

mainfrom

feat/metrics-suite

Open

Make the metrics suite complete and usable from one object#79
mkeeler43 wants to merge 18 commits into
mainfrom
feat/metrics-suite

Commits on Sep 25, 2026
- Make a metric one decorator and a board one object
  
  mkeeler43
  and
  claude
  committed
  efb8d42
- Add a notebook that walks the metrics suite on a toy problem
  
  mkeeler43
  and
  claude
  committed
  2c21d7b
- Port the metric suite onto the one-decorator contract
  
  mkeeler43
  and
  claude
  committed
  5a5a317
- Let a board choose its space, and load published checkpoints by name
  
  mkeeler43
  and
  claude
  committed
  5224615
- Describe the current metric suite where contributors read about it
  
  mkeeler43
  and
  claude
  committed
  1babd6a
- Format the notebook's code cells the way CI does
  
  mkeeler43
  and
  claude
  committed
  3c6e6f5
- Put the notebook's imports where the linter expects them
  
  mkeeler43
  and
  claude
  committed
  32afcc7
Commits on Sep 28, 2026
- Say what each metric measures and how to read its scale
  
  mkeeler43
  and
  claude
  committed
  3cc4150
- Run the metrics notebook on beams2d with published checkpoints
  
  mkeeler43
  and
  claude
  committed
  62812ca
- Measure memorization as a distance, without a tolerance
  
  mkeeler43
  and
  claude
  committed
  1126e7d
- Stop passing the spec to push_to_hub, which no longer reads it
  
  mkeeler43
  and
  claude
  committed
  0af3a34
- Drop the evaluator argument _publish stopped using
  
  mkeeler43
  and
  claude
  committed
  ab2ef94
Commits on Sep 29, 2026
- Measure settling against the optimum, and size the kernel from the training data
  
  mkeeler43
  and
  claude
  committed
  68b32b9
- Explain the evaluation context before asking the reader to write a metric
  
  mkeeler43
  and
  claude
  committed
  59c198d
- Address the first review: one default spec, conditions for saved designs, and a board that keeps its registry
  
  mkeeler43
  and
  claude
  committed
  cc5f16e
- Re-run the notebook with the renamed explain column
  
  mkeeler43
  and
  claude
  committed
  6a1ad77
Commits on Sep 30, 2026
- Address the second review: one CLI default, a volume budget the board knows, one bandwidth per board
  
  mkeeler43
  and
  claude
  committed
  481fd39
Commits on Oct 1, 2026
- Let the board take the test rows themselves, and the evaluator a chosen slice
  
  mkeeler43
  and
  claude
  committed
  876e094

Commits

Commits on Sep 25, 2026

Commits on Sep 28, 2026

Commits on Sep 29, 2026

Commits on Sep 30, 2026

Commits on Oct 1, 2026