Skip to content

Add MI under-age-1 reproducer for state dataset undercount (#135)#136

Closed
DTrim99 wants to merge 3 commits into
PolicyEngine:mainfrom
DTrim99:issue-135-mi-under-1-investigation
Closed

Add MI under-age-1 reproducer for state dataset undercount (#135)#136
DTrim99 wants to merge 3 commits into
PolicyEngine:mainfrom
DTrim99:issue-135-mi-under-1-investigation

Conversation

@DTrim99

@DTrim99 DTrim99 commented May 19, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Adds us/poverty/michigan_under_age_1.ipynb — a minimal reproducer for the state-dataset population undercount documented in State-specific .h5 datasets undercount population by 30-65% #135.
  • Computes children under age 1 in Michigan using two approaches: the state-specific MI.h5 dataset and the national dataset filtered to MI via state_code.
  • Surfaces the ~59% MI population gap (4.1M state ds vs 10.1M national-filtered vs ~10.1M Census).

Test plan

  • Notebook executes end-to-end with policyengine_us and produces the comparison table.
  • Findings cross-checked against Census population and MDHHS births.

DTrim99 and others added 3 commits March 19, 2026 17:08
Three reform variants analyzing CTC and EITC changes:
- Reform 1: CTC $3,600-$4,440 (2026-2035)
- Reform 2: CTC $3,000-$3,600 (2026-2035)
- Reform 3: CTC $2,700-$3,300 (2026-2035)

Each notebook includes:
- Comprehensive 2026 impact analysis (poverty, deciles, winners/losers)
- 10-year federal budgetary projections
- CSV exports for both 2026 impacts and 10-year projections

Closes PolicyEngine#125

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Demonstrates the state-specific MI.h5 dataset undercounts Michigan
population by ~59% relative to the national dataset filtered by
state_code. See PolicyEngine#135 for the systemic state-dataset issue.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@MaxGhenis

Copy link
Copy Markdown
Contributor

Thanks @DTrim99 — adopted onto an org branch and merged as #137 with your reproducer commit and authorship preserved. Two changes from this PR: (1) the ~8.4k lines of unrelated us/searchlight_institute/ files this branch dragged in were excluded — they duplicate your open #126, which stays the home for that work; (2) a status addendum + fresh execution, because the notebook no longer reproduces the #135 undercount: states/MI.h5 was replaced upstream in the us-data 1.115.4-patch promotion on 2026-05-20 (the day after you filed #135) and now totals 10,119,131 ≈ Census. The rerun instead surfaced a current under-1 geography defect in the pinned populace national dataset (MI 40.2K vs ~104K births; CA at 21.7% of US infants) — filed with receipts as populace#520. Closing in favor of #137.

MaxGhenis added a commit that referenced this pull request Jul 24, 2026
…0) (#137)

* Add MI under-age-1 reproducer comparing state vs national datasets

Demonstrates the state-specific MI.h5 dataset undercounts Michigan
population by ~59% relative to the national dataset filtered by
state_code. See #135 for the systemic state-dataset issue.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* Add status addendum: #135 undercount fixed upstream; under-1 gap moved to populace#520

Re-executed 2026-07-23 with policyengine-us 1.782.0: states/MI.h5 (replaced
in the us-data 1.115.4-patch promotion, 2026-05-20) now totals 10,119,131,
matching Census. The national default (pinned populace_us_2024 release) puts
MI under-1 at 40,204 vs ~104K MDHHS births, with CA at 21.7% of US infants -
filed as populace#520. As-filed outputs preserved in #135/#136.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

---------

Co-authored-by: David Trimmer <david@policyengine.org>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@MaxGhenis MaxGhenis closed this Jul 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants