Repository navigation
Conversation
…GOES notebook The catalog validation scripts, their helpers, and the element sets only they read move out of docs/validation to a top-level validation/catalog folder, with a README on running them. Scripts take the record, fixture, and element set folders and their own source path from validation_io instead of repeating them, and the validation records cite the new paths. ValidateGeostationaryGOES is removed, as validate_catalog_abi tests the same products; the remaining validation notebooks are grouped by capability.
…book tests The CrIS, AMSR2, GMI, MODIS, and SMAP radiometer validation scripts gain a --fit mode that measures their entries' fitted values as the notebooks did, and the entries' provenance cites the scripts. A shared fit_cone helper measures conical scanners, MODIS reductions keep the reported velocity, and the scripts log in to NASA Earthdata with EARTHDATA_TOKEN or ~/.netrc. The ATMS, CrIS, VIIRS, MODIS, AMSR2, GMI, NISAR, and Sentinel-1 notebooks drop the pass, epoch, and swath area tests that the catalog's validation now runs on held-out data; the summary, standard, and scripts cite what remains.
…yout # Conflicts: # .gitignore # CHANGELOG.md # docs/validation/ValidateImagerCrIS.ipynb # docs/validation/index.rst
…grade, compute the holdout gap from the periods of fitting and test data, record transfers apart and the standard version of each configuration, check record platforms and class versions, build payloads of several entries (also in build_constellation, with start and end for tilt schedules), give the analysis index of unions, rename attitude_schedule to tilt_schedule, move the subsolar latitude to utils, default the provenance of tailored and swept views, keep the gates in one table, trim the exports, write records through the schema, pass JPSS archives explicitly, deduplicate the conical scripts, and test the status of entries from one table
…with evidence gaps apart from gates), build satellites from payloads (InstrumentPayload.to_satellite), write records and transfers by entry (refusing transfers to stale records, keeping scopes), key class versions by class, drop Configuration.is_fitted, and require a grouping only for several instruments
…struments, coverage, limb_and_space, ground_systems, trade_studies), each with its own page, sharing one cache of downloads in docs/validation/data, with the element sets of the occultation and satellite-to-satellite notebooks in limb_and_space/elements
…overage, limb_and_space, ground_systems, beside osse and tradespace), each with its own page, with the files they read beside them and the GNSS element sets of CollectRO in limb_and_space/elements
…, grouped by grade, and state that a gate takes the worst value over scopes
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Reorganizes the validation of the instrument catalog and the documentation around it, and applies two reviews of
tatc.catalog.Catalog validation
validation/catalogand retires the GOES notebook. Fitted values now come only from each script's--fitrun, and notebook tests that repeated the scripts' tests are removed.InstrumentEntry.validationlists every gap of an entry: missing grades, each configuration's gaps, and evidence gaps apart from gates.catalog.build_payloadandInstrumentPayload.to_satellitebuild satellites that carry instruments from several entries;build_constellationaccepts payloads too.xarrayto thevalidationextra, which the ABI, AHI, and KaRIn scripts need.Documentation
docs/validation/data.docs/validation/standard.rst) gains a Metrics section that says what each gated metric measures and how, and that a gate takes the worst value over scopes.Breaking changes
attitude_scheduleis renamedtilt_schedule.Configuration.is_fittedis removed.tatc.catalogare trimmed.