I/O improvements - #42

Draft

wx4stg wants to merge 32 commits into

deeplycloudy:masterfrom

wx4stg:io-improv

Commits on Dec 28, 2023

add lma writer
wx4stg
committed
d3931c7

Commits on Jul 1, 2024

use xarray sizes instead of dims (warning silence)
wx4stg
committed
aacf855
add original_filename, fix station network location
wx4stg
committed
f5bfa96
properly support stations appearing/disappearing/moving
wx4stg
committed
fe657e4
preserve event_id == number_of_events (deeplycloudy/xlma-python#43)
wx4stg
committed
043acd8
add station_active flag
wx4stg
committed
25385bb
part 2 to 25385bb, actually commit the cf_netcdf file this time
wx4stg
committed
1477a42
fill in known values when stations are offline
wx4stg
committed
fb0b3ab

Commits on Jul 5, 2024

only reduce number_of_files if it exists
wx4stg
committed
b5555e9

Commits on Jul 18, 2024

Merge branch 'master' of https://github.com/deeplycloudy/xlma-python into io-improv
wx4stg
committed
fb1a2ca

Commits on Jul 19, 2024

Merge branch 'master' of https://github.com/deeplycloudy/xlma-python into io-improv
wx4stg
committed
7031649

Commits on Jul 23, 2024

Merge branch 'writer' of https://github.com/wx4stg/xlma-python into io-improv
wx4stg
committed
fc4419a

Commits on Jul 24, 2024

identify unique network configurations instead of individual files
wx4stg
committed
d458c22
start time, end time, and analyzed sec of dataset, warn if mismatch
wx4stg
committed
fe6225c
lma dat header (mostly)
wx4stg
committed
27b3c10

Commits on Jul 28, 2024

make station event fraction a percentage as described by metadata
wx4stg
committed
3a4c1b3
track data coverage across network configs and gaps in coverage
wx4stg
committed
32e90d7
use template cf dataset to restore metadata when combining #11
wx4stg
committed
caaf607
fix cf comparison
wx4stg
committed
81502fd
that's not an xarray yet
wx4stg
committed
9491cc2
recalculate station mask after combine
wx4stg
committed
dffb0fb
try to make station IDs unique, fix writing, dont recalc center unless necessary
wx4stg
committed
8ad6f09
reading multifile test more comprehensive
wx4stg
committed
1e739f6
vectorize station mask calculation
wx4stg
committed
e72b3b4

Commits on Jul 29, 2024

read station name, board revision, delay, and rec_ch
wx4stg
committed
3e76283
this doesn't appear to be used for anything...
wx4stg
committed
0cb0d9c
make fill values more obvious
wx4stg
committed
17e8910
remove newlines from attrs
wx4stg
committed
55c29e1
add new properties
wx4stg
committed
0cc3204
better handle combining new attrs
wx4stg
committed
0defdea
dat.gz write support!
wx4stg
committed
d2b28e3

Commits on Aug 9, 2024

Merge branch 'master' of https://github.com/deeplycloudy/xlma-python into io-improv
wx4stg
committed
6c1311e