Repository navigation

Feature combine retrievers - #63

Merged

danamir1 merged 122 commits into

devfrom

feature-combine-retrievers

May 5, 2026

Merged

Feature combine retrievers#63
danamir1 merged 122 commits into
devfrom
feature-combine-retrievers

Commits on Mar 16, 2026
- Fix small bugs - correct config naming (without .csv in the middle) and correct validation of the number of inputs.
  danamir1
  committed
  268aaaa
Commits on Mar 17, 2026
- Combine old and new retrievers and support all together.
  danamir1
  committed
  c86a300
- remove TODOs
  danamir1
  committed
  4ab7b1c
Commits on Mar 18, 2026
Commits on Mar 19, 2026
- clean the appsync downloader
  danamir1
  committed
  919f8e7
- improve data dumps naming scheme
  danamir1
  committed
  8522595
- Dump configs by default
  danamir1
  committed
  40265c8
- change console script name
  danamir1
  committed
  5f62433
- fix prettifying json dumps
  danamir1
  committed
  d111b7e
- change to Roy's faster prettifying solution and spelling correction
  danamir1
  committed
  ea55bb1
- add general support for before and after filtering and combine script arguments into the configuration state
  danamir1
  committed
  eed5f45
- single source of truth for argument naming
  danamir1
  committed
  72b6911
Commits on Mar 22, 2026
- fix save of temporary file in the RM1 downloader
  danamir1
  committed
  0a75b3f
- remove irrelevant RM2 staff
  danamir1
  committed
  5e7dbdd
Commits on Mar 24, 2026
- fix input definition validation and error messages
  danamir1
  committed
  9c3a5f2
- save data retriever output path as a field
  danamir1
  committed
  eb9bee8
- fix RM1 dump timestamp conversion code (allow mixed formats) and validate timestamp correctness in the parser (before using it to filter game events).
  danamir1
  committed
  6dcefda
- avoid spaces in data source name (for easier usage as script argument)
  danamir1
  committed
  da0d9f1
- fix loading from file bug
  danamir1
  committed
  efe98c0
- fix tests to fit the new API
  danamir1
  committed
  12af81a
- add new duplicate games drop logic (to ignore very short games before a valid game)
  danamir1
  committed
  b99ee37
- reuse dump naming code as a utility function
  danamir1
  committed
  08c9e21
- fix deepcopy call
  danamir1
  committed
  c9f0bcc
- update tests to fit the new API
  danamir1
  committed
  7caddb6
- add g and alpha and safer organization of dataset statistics APIs
  danamir1
  committed
  9919759
- set default values to support older versions correctly
  danamir1
  committed
  84c304a
Commits on Mar 25, 2026
Commits on Mar 26, 2026
- add logging
  danamir1
  committed
  5835d03
Commits on Mar 31, 2026
Commits on Apr 1, 2026
- add comment about the parser ID columns meaning
  danamir1
  committed
  e401dd4
Commits on Apr 5, 2026
- Added visualizations to the pipeline
  YogevHend
  committed
  5d68240
- Added some more configuration/verbosity to visualizations
  YogevHend
  committed
  8b8ac28
- Removed dependency on simCFG and some unused codelines
  YogevHend
  committed
  cc99e01
Commits on Apr 6, 2026
- improve viz efficiency and fix some bugs
  danamir1
  committed
  3650db8
Commits on Apr 9, 2026
- Now plot game also plots dt/save time, also fixed a few bugs in the plot
  YogevHend
  committed
  d434a21
Commits on Apr 12, 2026
- add support for rm1 pipeline with game id.
  danamir1
  committed
  a6f6dc0
- indicate that one can set the env vars for cfg username and password
  danamir1
  committed
  6fb27ab
- added a smoke test as a github workflow
  YogevHend
  authored
  bf2e2e8
- support output filenames which require creating directories
  danamir1
  committed
  89a67ba
- Merge remote-tracking branch 'origin/feature-combine-retrievers' into feature-combine-retrievers
  danamir1
  committed
  5e51670
- added pyproject.toml
  YogevHend
  committed
  87498f1
- Merge branch 'feature-combine-retrievers' of https://github.com/ComDePri/CFGpy into feature-combine-retrievers
  YogevHend
  committed
  9e08d36
- fixes to pyproject.toml
  YogevHend
  committed
  e3aaf8f
- Update smoke-test.yml
  YogevHend
  authored
  9880a9f
- Updated pyproject.toml
  YogevHend
  committed
  2aa380d
- Merge branch 'feature-combine-retrievers' of https://github.com/ComDePri/CFGpy into feature-combine-retrievers
  YogevHend
  committed
  b18e976
- small fix to pyproject.toml
  YogevHend
  committed
  e173932
- Update Python version in smoke test workflow
  YogevHend
  authored
  94db1f4
- Now with config yaml and python version
  YogevHend
  committed
  398c900
- Merge branch 'feature-combine-retrievers' of https://github.com/ComDePri/CFGpy into feature-combine-retrievers
  YogevHend
  committed
  e2d90c1
Commits on Apr 13, 2026
- fix double config dump in postparser
  danamir1
  committed
  16a12d1
Commits on Apr 16, 2026
- add tests
  danamir1
  committed
  fb732e5
- Merge remote-tracking branch 'origin/feature-combine-retrievers' into feature-combine-retrievers
  danamir1
  committed
  06d562a
Commits on Apr 19, 2026
- small fixes suggested by copilot
  danamir1
  committed
  cdf0673
Commits on Apr 26, 2026
- fix new platform name
  danamir1
  committed
  0d1dae4
- fix animation config args
  danamir1
  committed
  debf3c9
- fix invalid username characters (and testing)
  danamir1
  committed
  5e24e70
- improve help messages for script arguments
  danamir1
  committed
  d325a8c
- align rm2 field and events naming with the rest of the data formats
  danamir1
  committed
  22374cf
- update README to fit the current version
  danamir1
  committed
  0502a8f
- update CFG package version and change default data source to IOCANE
  danamir1
  committed
  915263c
- Change data source from AppSync to IOCANE in smoke test
  danamir1
  authored
  120a255
- Merge remote-tracking branch 'origin/feature-combine-retrievers' into feature-combine-retrievers
  danamir1
  committed
  10d2120
- fixes based on copilot PR
  danamir1
  committed
  92bc7b7
Commits on Apr 27, 2026
Commits on Apr 29, 2026
- bug fix in feature extractor config dumping (correct path)
  danamir1
  committed
  a16ec7d
- update tests
  danamir1
  committed
  7e3d6ca
- update test files (remove CFGPY version and change features csv name)
  danamir1
  committed
  f0a8add
- ensure that the dumped config sets the maximal event time to the current time for future consistency
  danamir1
  committed
  9fc8258
- make sure config defaulting happens only in the parent class DataRetriever
  danamir1
  committed
  c0b2b7c
- safe time filtering for cases where rows have no valid timestamp
  danamir1
  committed
  56a596b
- bug fix in feature extractor dumping
  danamir1
  committed
  e200406
- safer game-IDs parsin in multigame retriever
  danamir1
  committed
  0c72fac
- fix script testing naming
  danamir1
  committed
  3907715
- safe config BEFORE parsing
  danamir1
  committed
  013f3e8
Commits on Apr 30, 2026
- safe handling of datasets with no valid games
  danamir1
  committed
  a43730a
- correct extraction of player external ID in IOCANE
  danamir1
  committed
  a6f7cec
- add migration tests and improve dataframe comp for json-dict columns
  danamir1
  committed
  4f8b6b2
- avoid fails on empty data
  danamir1
  committed
  5587669
- make parsed data tests empty data compatible
  danamir1
  committed
  ecf7858
Commits on May 1, 2026
- define df columns regardless of data rows existence
  danamir1
  committed
  9ccb379
- fix bug in GC calculation for small datasets with no edges
  danamir1
  committed
  e9f0c74
- safe extraction of external IDs when player metadata can be None
  danamir1
  committed
  51b8392
- compare parsed data only when it is not empty
  danamir1
  committed
  2285e1a
Commits on May 3, 2026
- safe check for unique customdata values
  danamir1
  committed
  8fd336b
- filter unparsable games instead of failing
  danamir1
  committed
  1a1eb66
Commits on May 4, 2026
- two-step connection to IOCANE (with new API endpoint)
  danamir1
  committed
  665da4c
- Support events caching for IOCANE retriever
  danamir1
  committed
  08b9bc1
- remove secrets
  danamir1
  committed
  75b2465
- correct parsing of invalid shape data (with None's)
  danamir1
  committed
  2148c75
- improve readme
  danamir1
  committed
  977527a
- fix testing
  danamir1
  committed
  9eb2001
- remove deprecated config fields
  danamir1
  committed
  ce9dd43
- improve caching
  danamir1
  committed
  d2c4ee4
Commits on May 5, 2026
- Small readme update
  YogevHend
  authored
  d5d9c06

Commits

Commits on Mar 16, 2026

Commits on Mar 17, 2026

Commits on Mar 18, 2026

Commits on Mar 19, 2026

Commits on Mar 22, 2026

Commits on Mar 24, 2026

Commits on Mar 25, 2026

Commits on Mar 26, 2026

Commits on Mar 31, 2026

Commits on Apr 1, 2026

Commits on Apr 5, 2026

Commits on Apr 6, 2026

Commits on Apr 9, 2026

Commits on Apr 12, 2026

Commits on Apr 13, 2026

Commits on Apr 16, 2026

Commits on Apr 19, 2026

Commits on Apr 26, 2026

Commits on Apr 27, 2026

Commits on Apr 29, 2026

Commits on Apr 30, 2026

Commits on May 1, 2026

Commits on May 3, 2026

Commits on May 4, 2026