Skip to content

feat(agent): validate evolved skill drafts - #140

Merged
Pepps233 merged 3 commits into
feat/outcome-aware-skill-synthesisfrom
feat/validate-evolved-skill-drafts
Aug 31, 2026
Merged

Pepps233 merged 3 commits into
feat/outcome-aware-skill-synthesisfrom
feat/validate-evolved-skill-drafts

Conversation

@Pepps233

@Pepps233 Pepps233 commented Aug 27, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Deterministically validate synthesized skill drafts for structure, provenance, workspace safety, version consistency, and sensitive data before allowing them to enter later evolution lifecycle stages.

Reasoning

Synthesized drafts are durable but untrusted artifacts. They need a deterministic gate that rejects malformed, stale, provenance-incomplete, locally referenced, oversized, or sensitive content before any behavioral evaluation, writing, or activation can be considered.

Validation reuses the canonical harness skill parser for in-memory drafts and persists immutable reports with resumable candidate transitions. Only accepted drafts advance to structurally-valid; rejected drafts remain outside downstream execution paths.

Changes

  • Expose canonical harness skill validation for in-memory draft content.
  • Add deterministic structural, provenance, workspace, version, size, and sensitive-data validation.
  • Persist immutable validation reports and resumable candidate validation checkpoints.
  • Advance accepted drafts to structurally-valid while preserving rejected drafts and reports for review.
  • Wire background draft validation into the coding-agent evolution runtime.
  • Document validation recovery and terminal-state behavior.

User impact

Invalid or unsafe generated drafts are rejected before downstream processing. Accepted drafts become eligible only for later evaluation work; this pull request does not install, write, or activate generated skills.

Stack

Position: 6 of 12
Base: #139
Next: #147

  1. feat(coding-agent): activate versioned evolved skills #134
  2. feat(agent): preserve target-neutral reflection evidence #136
  3. feat(agent): curate and checkpoint skill candidates #137
  4. feat(agent): persist and process skill candidate registry #138
  5. feat(agent): synthesize outcome-aware skill drafts #139
  6. feat(agent): validate evolved skill drafts #140 (this PR)
  7. feat(agent): measure procedural information loss #147
  8. feat(agent): evaluate evolved skill candidates #148
  9. feat(agent): activate evolved skill candidates #149
  10. feat(agent): observe evolved skill lifecycle outcomes #150
  11. feat(agent): define evolved skill memory handling #151
  12. feat(coding-agent): add evolved skill operator controls #152

Testing

  • npm run check
  • cd packages/harness-state && node ../../node_modules/vitest/dist/cli.js --run test/harness-state.test.ts
  • cd packages/evolution && node ../../node_modules/vitest/dist/cli.js --run test/skill-draft-validator.test.ts test/skill-synthesizer.test.ts test/skill-candidate-registry.test.ts test/skill-candidate-worker.test.ts test/filesystem-store.test.ts
  • cd packages/coding-agent && node ../../node_modules/vitest/dist/cli.js --run test/evolution-runtime.test.ts

This pull request is AI-generated by Diffex.

@Pepps233
Pepps233 force-pushed the feat/validate-evolved-skill-drafts branch from 6e32413 to acebff0 Compare August 30, 2026 21:32
@Pepps233
Pepps233 merged commit cdd8866 into main Aug 31, 2026
0 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant