Repository navigation
Package unfamiliar data and grade reproduced report facts - #12
Draft
hudsonaikins wants to merge 1 commit into
Draft
hudsonaikins wants to merge 1 commit into
hudsonaikins wants to merge 1 commit into
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Add a manifest-bound package Store for unfamiliar raw data, plus evaluator-owned report-to-reference grading. Qualified transport and energy packages expose only explicitly allowlisted, checksum-pinned files through individual read-only mounts. Discovery keeps raw labels and sentinels visible; input/file/schema limits are enforced.
The retained preparation includes source qualification, public development tasks, a reserved-task commitment and independent Python/SQL reference checks. Exact reserved questions, answers, raw data and evaluator outputs stay outside Git and analyst access. The grader binds report/run/reference identities and independently interpreted units, population, window and grain; correct cells never imply that arbitrary prose or causal claims pass.
A scripted real-source SmolVM smoke passed isolation, source immutability, evidence reproduction and HTML/PNG/CSV/XLSX delivery, with both mapped transport counts matching independent references. It used zero provider calls and deliberately leaves task_pass null. This is integration evidence, not a live unknown-domain model result.
Validation: full suite 235 passed/15 skipped, followed by 30 focused package/reference checks including alternative layouts and refusal boundaries. Ruff lint/format, Vulture, Gitleaks and diff checks passed. CI will validate the published head.
Remaining: arbitrary discovery-claim verification, causal/refusal semantics, frozen campaign/allowance and live trials. The >=10 GiB workload remains separate. See docs/research/unfamiliar-package-integration.md. Tracks INT-440, INT-441, INT-442 and INT-443. No release or deployment.