Skip to content

Prove automatic Kubernetes worker failure recovery - #581

Merged
RicheyWorks merged 4 commits into
mainfrom
codex/kubernetes-automatic-worker-failure-proof
Aug 21, 2026
Merged

Prove automatic Kubernetes worker failure recovery#581
RicheyWorks merged 4 commits into
mainfrom
codex/kubernetes-automatic-worker-failure-proof

Conversation

@RicheyWorks

Copy link
Copy Markdown
Owner

Outcome

  • preserve the operator-remediated abrupt worker-loss proof and add a separate automatic failure-detection phase
  • pin the disposable cluster to a 20-second node-monitor grace period and all qualification workloads to 10-second not-ready/unreachable NoExecute tolerations
  • kill a worker without drain or post-failure Kubernetes remediation, then bound node detection, EndpointSlice withdrawal, pod eviction, degraded traffic, fresh-identity recovery, and two-zone traffic distribution
  • advance the fail-closed topology profile/evidence schema to 7 and reject 83 unsafe profile variants

Verification

  • focused KubernetesLiveTopologyContractTest passed
  • full Maven suite passed: 2,694 tests, 0 failures/errors/skips
  • both changed shell scripts pass bash -n from the normalized Git index
  • JSON profile parsing and git diff --check passed

Evidence boundary

This is a disposable loopback kind proof with test-configured controller timing. It does not establish deployment-equivalent failure timing, external ingress behavior, capacity, registry integrity, or production readiness. Exact-head CI must run the live kind phase.

@RicheyWorks
RicheyWorks merged commit 5b22750 into main Aug 21, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant