Add new application: sbd - #73
Draft
william-dawson wants to merge 7 commits into
Draft
Conversation
william-dawson
force-pushed
the
add-sbd-benchkit
branch
2 times, most recently
from
July 31, 2026 06:24
a53bf73 to
86370ce
Compare
william-dawson
marked this pull request as ready for review
July 31, 2026 06:26
william-dawson
force-pushed
the
add-sbd-benchkit
branch
from
July 31, 2026 06:41
86370ce to
ec3d671
Compare
william-dawson
marked this pull request as draft
July 31, 2026 06:59
Signed-off-by: William Dawson <william.dawson@riken.jp>
Signed-off-by: William Dawson <william.dawson@riken.jp>
Signed-off-by: William Dawson <william.dawson@riken.jp>
Signed-off-by: William Dawson <william.dawson@riken.jp>
Signed-off-by: William Dawson <william.dawson@riken.jp>
Signed-off-by: William Dawson <william.dawson@riken.jp>
william-dawson
force-pushed
the
add-sbd-benchkit
branch
from
August 5, 2026 16:08
528c1d7 to
c36d32d
Compare
list.csv set nthreads=1 for all three RIKYU rows, which queue.csv wires straight into --cpus-per-task and run.sh's OMP_NUM_THREADS. That starves RemakeHelpers/TaskCostSize, a genuine host-side OpenMP pass that builds the rank-distribution cost estimate before Davidson starts -- confirmed via gdb backtrace on 2026-08-06 while investigating a run that looked hung for 18+ minutes on the 1em7 input at 4 GPUs. Raising threads to 32 (matching Rikyu's per-GPU CPU cap on shared nodes) fixed it; the same degenerate layout completes in about two minutes on a comparable input. module purge already precedes module load in both build.sh and run.sh for RIKYU, so no fix was needed there -- checked before touching it. Only the 8-GPU row in README.md's validated table was independently re-run before now (per the paragraph above it); flag the 4- and 16-GPU rows as unverified under the old nthreads=1 configuration rather than silently changing the numbers. Signed-off-by: William Dawson <william.dawson@riken.jp>
william-dawson
force-pushed
the
add-sbd-benchkit
branch
from
August 5, 2026 16:12
c36d32d to
a7c566a
Compare
Collaborator
|
Could you please remove the large SBD input data files from this PR? Keeping large application-specific input files in the BenchKit repository increases the clone/fetch cost for every pipeline, including runs for unrelated applications. I think the better direction is to keep only the input metadata, provenance, URLs, and checksums in the repository, and have the SBD build/run path fetch the required data when SBD is executed. Thanks! |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Depends on #74.
The branch intentionally contains #74 so the complete SBD pipeline can be
tested before the shared site fix merges. The SBD-only changes can be reviewed
at:
william-dawson/benchkit@fix-rikyu-cloud-site...add-sbd-benchkit
Summary
Add SBD selected-basis diagonalization as a BenchKit application for Rikyu
B200 GPUs and R-CCS Cloud DGX Spark.
Changes
programs/sbd/build.shwith NVHPC 26.3 Thrust builds:cc100, rank distribution, block distribution, index reordering,safe MPI allreduce, and NCCL.
cc120, rank distribution, block distribution, indexreordering, and safe MPI allreduce.
programs/sbd/run.shwith one MPI rank per GPU and explicit local GPUbinding.
wall time.
emitting a result.
1em5input.checksum, and Apache-2.0 provenance.
Validation
DGX Spark
-76.24373504205295 Ha.228.928853 s.1em7input was rejected for this target after reaching about98 GB before Davidson;
1em5completes with adequate memory headroom.Rikyu
rkp00012, one MPI rank per B200.-76.243776776861 Ha.A fresh validation of this BenchKit branch:
gpuand accountrkp00012;9481f290c2f49d4f8e5df9b0c9c87ea0f7937c2cthroughbuild.sh;cc100rank-distributed/index-reordered/NCCLCMake configuration;
scripts/test_submit.sh;-76.2437767768609 Hawith a290.281226 sinternal DavidsonFOM; and
multtiming section.
Additional checks
build.shandrun.sh.git diff --checkpasses.