All pull requests

Pull requests

• fix: report unscorable MCQ samples instead of scoring them 0.0 (#1140)

  community-requestwaiting-on-maintainers
  #1158·chethanuk opened Sep 5, 2026·

  ·
  5

• fix(gate): stop counting infra-errored samples as wrong answers

  community-requestwaiting-on-maintainers
  #1155·arthi-arumugam-git opened Aug 30, 2026·

  ·
  12

• fix(adapters): include full request body in cache keys

  community-requestwaiting-on-maintainers
  #1153·rioyu123 opened Aug 29, 2026·

  ·
  10

• fix: fail loudly instead of silently falling back to exact match in Skills env

  community-requestwaiting-on-maintainers
  #1148·arthi-arumugam-git opened Aug 15, 2026·

  ·
  1

  6

• ci: Version bump to 0.6.0rc0.dev0

  #1147·github-actions[bot] opened Aug 13, 2026Bot·

  ·
  1

• fix: remove unused RUN_ID environment variable

  community-requestwaiting-on-maintainers
  #1145·andrewwhitecdw opened Aug 13, 2026·

  ·
  2

• fix: copyright-check-summary references undefined $SKIPPING_IS_ALLOWED

  community-requestwaiting-on-maintainers
  #1144·andrewwhitecdw opened Aug 13, 2026·

  ·
  5

• fix: create-gh-release input is forced to true

  community-requestwaiting-on-maintainers
  #1143·andrewwhitecdw opened Aug 13, 2026·

  ·
  2

• chore: update claude review to FW-CI-templates v1.8.5

  #1134·kajalj22 opened Jul 29, 2026Contributor·

  ·
  2

• feat: request and capture provider token IDs in model traffic

  #1131·AWarno opened Jul 27, 2026Contributor·

  ·
  23

• fix(harbor): harden OpenHands trajectory flush

  #1130·AWarno opened Jul 27, 2026Contributor·

  ·
  21

• cp: fix(harbor): local httpbin for the psf/requests SWE-B tasks (1120) into r0.4.0

  cherry-pickRun CICD
  #1127·svcnvidia-nemo-ci opened Jul 22, 2026·

  ·
  3

• fix: support local Slurm job lifecycle without SSH hostname

  #1121·yingguo-trt opened Jul 21, 2026Contributor·

  ·
  6

• feat: forward tools to model and harden managed Gym lifecycle

  community-requestwaiting-on-maintainers
  #1115·pachmu opened Jul 15, 2026·

  ·
  24

• fix: native skills aime26

  community-requestwaiting-on-customer
  #1113·trantrieuvy opened Jul 13, 2026·

  ·
  8

• fix(healthbench): update dataset loading URL to correct path

  community-requestwaiting-on-maintainers
  #1108·cris96spa opened Jul 9, 2026·

  ·
  3

• fix(xstest): update CSV URL and rename ID field for consistency

  community-requestwaiting-on-maintainers
  #1107·cris96spa opened Jul 9, 2026·

  ·
  3

• fix(triviaqa): update dataset loading path to use correct repository

  community-requestwaiting-on-maintainers
  #1104·cris96spa opened Jul 9, 2026·

  ·
  5

• fix(judge): don't let an unparseable judge reply silently score 0

  community-requestwaiting-on-maintainers
  #1094·Vidhate opened Jun 29, 2026·

  ·
  17

• feat: in-container local sandbox + reasoning-model scoring fixes

  #1093·hychiang-git opened Jun 25, 2026·

  ·
  26

• fix(adapters): add Qwen-safe turn_counter reminder modes

  #1090·fsiino-nvidia opened Jun 24, 2026·

  ·
  13

• feat: derive version from git tags via hatch-vcs

  #1081·wprazuch opened Jun 17, 2026Contributor·

  ·
  12

• docs: drop 0.1.0 (NeMo Eval predecessor) from version switcher

  #1064·lbliii opened Jun 8, 2026Contributor·

  ·
  2

• feat(benchmarks): add ToolSandbox multi-turn tool-use benchmark

  CItests
  #1018·wprazuch opened May 18, 2026Contributor·

  ·
  2

• experimental(slurm): add eval_ray_cluster multi-node bootstrap for agentic Gym evals

  nemo-evaluator-launchertests
  #1016·agronskiy opened May 15, 2026Collaborator·

  ·