Skip to content

feat(release-verify): verify v0.44.0, 34 → 42 passed and 3 → 0 failed, with a deploy freeze, the layout keys and marker counts - #27

Merged
robbeverhelst merged 1 commit into
mainfrom
verify-0-44
Sep 26, 2026
Merged

robbeverhelst merged 1 commit into
mainfrom
verify-0-44

Conversation

@robbeverhelst

Copy link
Copy Markdown
Contributor

Verifies Sluiceway v0.44.0 (997546c), three releases after the last verified v0.41.0. It checks that the three failures of v0.41.0 are fixed, and adds scenarios for the features of v0.42.0 to v0.44.0.

Scenario counts

One local run on the test bed sluiceway/release-verify, 2026-09-25 22:26 to 23:35 UTC, with the owner's gh login as the ticker, in 1,223 requests. The tool versions are the ones the action's e2e.yml pins at the tag, unchanged: Pulumi v3.263.0, OpenTofu 1.12.6. The counts are cells of the summary, one per scenario and adapter.

Passed Failed Skipped Total
Before: v0.41.0, its last run (scenarios 1 to 34) 34 3 (22, 23, 30) 3 40
After: v0.44.0 (scenarios 1 to 37) 42 0 3 45

Skipped in both: 21, and the admin part of 7 for OpenTofu. Both need a second account.

The three failures of v0.41.0

Each passes because its fix shipped in v0.42.2. Each assertion now checks the fix itself:

Scenario Fixed by What the run shows
22, after the tick sluiceway/sluiceway#274, record 0111 (#270) apply compared its commit with main and refused as moved, with no fresh preview. It started a full scan, which wrote the row pending with the new hash and the failure line. The comment says a newer commit reached the branch.
23, the minute sluiceway/sluiceway#275, record 0113 (#272) settle wrote the row itself 30 s after the cancel (44 to 63 s on v0.41.0), with state preview-failed, no box and the failure line. It logs Wrote the failure line on the row of ….
30 sluiceway/sluiceway#273, record 0112 (#271) The row holds <span>#</span>1 <span>@</span>sluiceway www&#46;example.com &#42;x&#42;. Neither the dashboard nor the preview page links, mentions or autolinks any part of it.

What changed

  • versions.json: SLUICEWAY_VERSION is v0.44.0.
  • New scenarios, all passing:
    • 35, a deploy freeze (record 0115). A tick inside the freeze waits on a record with window: true. The row and the dashboard name the freeze and its reason. "Run workflow" after the end deploys it.
    • 36, the layout keys (record 0114). With pendingDetail: compact and inSyncSection: off, every delete, replace and failure line stays and every marker is unchanged. The in sync rows move whole into the fold of sections that are off, and taking the keys out brings everything back.
    • 37, counts on a pending row's marker (record 0110). On every pending row a scan wrote, the counts match the result file and the first line. tracking and behind are not covered: no fixture moves a resource, and no scenario queues a stack behind another.
  • 33 no longer skips itself after 23:00 UTC: a window that crosses midnight is written as two. This run needed it, with a window that opened at 23:14 UTC.
  • The shared test bed: the driver waits for a head that ends in : done before its reset, and always leaves one, even when it fails. It keeps each run's logs the moment the run ends.
  • docs/findings.md: the entry for this verification. docs/release-verification.md: catalogue rows 35 to 37, and 22, 23, 30 and 33 updated. release-verify/README.md: the new file and the new running time (about 70 minutes).

No bug of the action was found, so nothing was filed.

🤖 Generated with Claude Code

…t keys and marker counts

- versions.json verifies v0.44.0; the tool versions are unchanged.
- 22, 23 and 30 assert the v0.42.2 fixes: the comparison with the branch
  (record 0111), the row settle writes (0113) and the new escaping (0112).
- New scenarios 35 (a deploy freeze, 0115), 36 (compact rows and In sync
  off keep the destroy lines, 0114) and 37 (counts on a pending row's
  marker, 0110).
- 33 writes a window that crosses midnight UTC as two instead of skipping.
- The driver waits for a test bed head ending in ": done", always leaves
  one, and keeps each run's logs the moment it ends.
- findings.md: 42 passed, 0 failed, 3 skipped against v0.44.0.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
@robbeverhelst
robbeverhelst merged commit 9fa71b4 into main Sep 26, 2026
1 check passed
@robbeverhelst
robbeverhelst deleted the verify-0-44 branch September 26, 2026 08:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant