Skip to content

test: Run one blockchain test at a time - #1690

Merged
chfast merged 1 commit into
masterfrom
test/blockchain-run-one
Sep 1, 2026
Merged

test: Run one blockchain test at a time#1690
chfast merged 1 commit into
masterfrom
test/blockchain-run-one

Conversation

@chfast

@chfast chfast commented Sep 1, 2026

Copy link
Copy Markdown
Member

A test which gave up took the rest of its file with it: the early
returns for an invalid block or a requests mismatch left the loop over
the whole span, so every test after it silently never ran. Taking one
test lets the caller which has the file's tests do the loop instead.

The index in the failure place goes with the loop, since the case name
above it already says which case failed: places read Cancun/2 rather
than Cancun/7/2. Most of the diff is the de-indent; git diff -w on
the runner is 36 lines added and 55 removed.

@codspeed-hq

codspeed-hq Bot commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

Merging this PR will not alter performance

✅ 129 untouched benchmarks


Comparing test/blockchain-run-one (d957fc2) with master (001414d)

Open in CodSpeed

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Refactors blockchain execution to process one test per runner invocation.

Changes:

  • Replaces span-based execution with a single-test API.
  • Moves file-level iteration into the CLI caller.
  • Simplifies failure locations by removing redundant case indexes.

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 3 comments.

File Description
test/utils/blockchaintest.hpp Declares the single-test runner.
test/utils/blockchaintest_runner.cpp Refactors execution for one test.
test/unittests/blockchaintest_runner_test.cpp Adopts the new API.
test/blockchaintest/blockchaintest.cpp Iterates tests at file level.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment thread test/blockchaintest/blockchaintest.cpp
Comment thread test/utils/blockchaintest.hpp
Comment thread test/utils/blockchaintest_runner.cpp
@codecov

codecov Bot commented Sep 1, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 88.39779% with 21 lines in your changes missing coverage. Please review.
✅ Project coverage is 97.98%. Comparing base (001414d) to head (d957fc2).

Files with missing lines Patch % Lines
test/utils/blockchaintest_runner.cpp 88.13% 15 Missing and 6 partials ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #1690      +/-   ##
==========================================
+ Coverage   97.94%   97.98%   +0.03%     
==========================================
  Files         181      181              
  Lines       16216    16211       -5     
  Branches     3729     3729              
==========================================
+ Hits        15883    15884       +1     
+ Misses        252      248       -4     
+ Partials       81       79       -2     
Flag Coverage Δ
eest-develop 87.10% <77.77%> (+<0.01%) ⬆️
eest-develop-gmp 26.17% <0.00%> (+<0.01%) ⬆️
eest-legacy 16.94% <69.61%> (-0.02%) ⬇️
eest-libsecp256k1 28.37% <0.00%> (+<0.01%) ⬆️
eest-stable 87.06% <77.77%> (+<0.01%) ⬆️
evmone-unittests 94.24% <70.16%> (+0.03%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Components Coverage Δ
core 96.19% <ø> (ø)
tooling 94.04% <88.33%> (+0.28%) ⬆️
tests 99.81% <100.00%> (ø)
Files with missing lines Coverage Δ
test/blockchaintest/blockchaintest.cpp 97.01% <100.00%> (ø)
test/unittests/blockchaintest_runner_test.cpp 100.00% <100.00%> (ø)
test/utils/blockchaintest_runner.cpp 89.71% <88.13%> (+1.91%) ⬆️
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@chfast
chfast force-pushed the test/blockchain-run-one branch from b56458f to d5b0489 Compare September 1, 2026 14:29
@chfast
chfast requested a balanced review from Copilot September 1, 2026 14:43

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 6 out of 6 changed files in this pull request and generated no new comments.

@chfast
chfast force-pushed the test/blockchain-run-one branch from d5b0489 to d989fa9 Compare September 1, 2026 14:45
A test which gave up took the rest of its file with it: the early
returns left the loop over the whole span, so every test after it never
ran. Taking one test lets the caller which has the file's tests do the
loop. The index in the failure place goes with the loop, since the case
name above it already says which case failed.
@chfast
chfast force-pushed the test/blockchain-run-one branch from d989fa9 to d957fc2 Compare September 1, 2026 15:04
@chfast
chfast merged commit c795076 into master Sep 1, 2026
24 of 25 checks passed
@chfast
chfast deleted the test/blockchain-run-one branch September 1, 2026 20:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants