Repository navigation
Route OpenHCS progress through inherited sequence admission #595
Description
A fresh ordinary three-case benchmark on PR #394 source 6809e5a5ce3532ce71c4fcbfc6d654f81bd3dcb8, using installed merged ZMQRuntime 04d813fe6c93f74166c05847afb1eae158d3c817, completed all three scientific jobs but rejected every throughput observation.
ExecutionClient._record_progress fails with KeyError: progress_sequence. OpenHCS publishes via three direct self.progress_queue.put(...) calls in ZMQExecutionServer._enqueue_progress and _forward_worker_progress. These bypass inherited ExecutionServer.send_progress_update, so emitted messages lack their sequence and execution records retain watermark zero. The new completion barrier therefore cannot observe these callbacks.
Fix all three producers to use the existing inherited admission method after OpenHCS event validation and topology enrichment. Keep worker-queue sentinels separate; do not add optional sequence fallbacks, duplicate counters, delays, status polling or benchmark waivers. Verify forwarding drains before terminal completion and exercise real subclass publication.
Retained failed campaign: /home/ts/.local/state/openhcs-maintenance/20261004/canonical-runtime-coherent-paired-v14-qualified; original ordinary stdout includes dispatch tracebacks. No second ordinary sweep or fresh native run was launched, and no accepted speedup is claimed. Runtime, controller and lease are terminal.
Implementation belongs to existing PR #394 and will be formally linked as a closing issue there.
Activity
Admit OpenHCS progress through the generic producer watermark
trissim commentedon Oct 4, 2026
Implemented in PR #394 commit
4f2e44701c1c5460ca7e447c7b3d05e3530367ad: all three OpenHCS progress producers use inherited sequence admission. The worker forwarder drains and joins before the generic execution runner records terminal completion. A real server/client control preserves sequence 1/2/3, watermark 3 and worker topology.Installed acceptance now passes: two ordinary sweeps complete the original 3D, Speckles and Beginner pipelines with complete well/progress observations, using merged ZMQRuntime
04d813fe6c93f74166c05847afb1eae158d3c817. Both fresh native observations also complete, and all 12 strict scientific comparisons pass.Current figures and qualification. Earlier V14 failures are preserved and rejected. This verifies this producer integration; it does not claim reliable PUB replay. The issue remains formally linked for closure when PR #394 merges.