Skip to content

Update protocol v0.4.6 and correct exposure metadata handoff - #16

Open
DougManuel wants to merge 3 commits into
mainfrom
metadata/exposure-handoff
Open

DougManuel wants to merge 3 commits into
mainfrom
metadata/exposure-handoff

Conversation

@DougManuel

@DougManuel DougManuel commented Sep 23, 2026 •

Copy link
Copy Markdown
Collaborator

Updates the protocol to v0.4.6 (summary v0.3.3) and corrects the exposure metadata needed for the Master-file handoff. The earlier imported racial mappings could misclassify valid responses, province had no rules for configured Master cycles, and education counted incomplete postsecondary study as graduation.

  • Correct racial-origin mappings separately for 2003, 2005--2014 and 2015--2018, including combined 2009--2010 coverage. Retain detailed source classifications as intermediate inputs; keep the pooled Master racial predictor disabled. Remove unverified 2001 coverage.
  • Import only upstream Master province rules, preserving the working local PUMF mappings. Require per-cycle rules for configured core demographic inputs.
  • Place incomplete postsecondary education in the middle category and remove unsupported 2022 PUMF individual-education coverage. Household education is not substituted.
  • Preserve arrival year, landed year and grouped duration separately. Retain the 2015--2021 landed-status question and the distinct 2022--2023 Master non-permanent-resident category. Correct the protocol's earlier implication that the status limitation begins in 2015.
  • Resolve secure configuration overrides, filter imputation predictors by source, and preserve stable dataset IDs while displaying cycles chronologically.
  • Document selective upstream provenance and local corrections in worksheets/README.md. Seven upstream blocks were initially reviewed; six changed because SDCGRES already matched.

Validation on September 23, 2026: 83 test cases and 307 assertions passed using cchsflow v3 at 2d3c1cad; 19 existing fixture/model warnings remain. New regression tests reproduced the defects before the fixes and now exercise every substantive source code in the corrected racial eras, province recodes in all 13 configured Master cycles, education, detailed immigration responses, coverage rejection and cycle ordering. All R files pass styler 1.11.0. The follow-up base-table audit confirms this correction changes only the four reviewed recoding blocks. Full protocol and summary Word builds succeeded, with valid XML, updated version stamps and no unresolved citation markers. Page layout was not visually checked. Rendered files remain local and ignored by Git.

This is a metadata and loading handoff, not completion of the protocol's analysis implementation. Arrival-based APC entry, source-specific NPR treatment, interval imputation, recent-PUMF history exclusions, all-imputation pooling and revised APC specifications remain outstanding. Secure delivery headers and source-specific smoking feeders still need checking in Maikol's environment. No secure Master-data or new end-to-end pipeline run is claimed. The dependency lock is unchanged. The existing docstyle health check reports six missing extension files for other formats; the Word builds succeed.

Copilot AI lite review requested due to automatic review settings September 23, 2026 01:53

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@DougManuel DougManuel changed the title Update protocol v0.4.5 and exposure metadata handoff Update protocol v0.4.6 and correct exposure metadata handoff Sep 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants