Issues

• Feedback for custom-agent integrators: files under /tmp persist across checkpoints and are readable by later agent sessions

  SprocketLab/slop-code-bench#44 · Filter by author SilverWhite opened on Oct 12, 2026

• External harness-native run (DeepSeek-V4.1-Flash / deepseek-flash + orz agent, k=1, 36 problems) — data contribution + leaderboard inclusion question + 2 oracle-validation re-checks

  SprocketLab/slop-code-bench#40 · Filter by author SilverWhite opened on Oct 7, 2026
  2

• bug: ClaudeCodeAgent saves the previous checkpoint's stdout.jsonl when a checkpoint crashes

  SprocketLab/slop-code-bench#36 · Filter by author carver opened on Sep 19, 2026

• Custom Agent Evaluation and Leaderboard Submission

  SprocketLab/slop-code-bench#33 · Filter by author manishdixitbuilds opened on Sep 10, 2026
  1

• I don't think the conclusion is well supported

  SprocketLab/slop-code-bench#32 · Filter by author weathon opened on Sep 3, 2026
  1

• Pinned answer keys fail evaluation in the official image

  SprocketLab/slop-code-bench#27 · Filter by author kimjune01 opened on Aug 11, 2026
  2

• Evaluate latest frontier models: Opus 4.8, Fable 5, GLM-5.2, DeepSeek-V4-Pro

  SprocketLab/slop-code-bench#18 · Filter by author lobanov opened on Jun 24, 2026
  2