Repository navigation

9.3.1 Flows - #86

Draft

davramov wants to merge 28 commits into

als-computing:mainfrom

davramov:flow-931

Commits on Jan 14, 2026
- init commit for bl 9.3.1
  davramov
  committed
  bac02a4
- Adjusting 9.3.1 endpoint configuration to use the compute-dtn globus collection
  davramov
  committed
  3738106
- Adding pytests for bl931 flows
  davramov
  committed
  8d6e834
- Making Config931 optional, since it is initialized within the methods if it is set to None
  davramov
  committed
  9b35bd3
- Adding documentation for bl 9.3.1 flows
  davramov
  committed
  4da35bf
- changing the data description in the documentation
  davramov
  committed
  19128a8
- Making the move flow call the move task, and updating the pytest/dispatcher/prefect.yaml reflect the change
  davramov
  committed
  62fd035
- Adjusting endpoint names in the test movement flow
  davramov
  committed
  8948b1d
- Ensuring get_run_logger() is set in the flight check
  davramov
  committed
  560259a
- if the transfer test fails, it should throw a runtime error
  davramov
  committed
  d395dcd
- updating init_work_pools to handle when beamline id is a number (e.g. 733 -> bl733 is the folder name) or a word (dichroism -> dichroism is the folder name)
  davramov
  committed
  ffcb3b4
- adjusting the test directory path for 931
  davramov
  committed
  0058581
- Pinning fastapi==0.116.1; breaks with fastapi==0.124.0
  davramov
  committed
  965df42
- Switching JSON Blocks to Variable Blocks
  davramov
  committed
  4832eb8
- Adding flow diagram to 9.3.1 documentation
  davramov
  committed
  d925c89
- Updating flight scheck to move globus_test/test.txt
  davramov
  committed
  4236517
- removing commented out code
  davramov
  committed
  fc437c6
- adding _sync=True to Variable.get() call and added missing flow_run_name from schedule_prefect_flow
  davramov
  committed
  c1689fc
- Adding verbose logging to process_new_931_file_task
  davramov
  committed
  ccaad74
- Adding transfer_success RuntimeError if False
  davramov
  committed
  79f280f
- Fixing the deployment name when scheduling prune_globus_endpoint
  davramov
  committed
  4b24dcb
- Adding beegfs endpoint for 931
  davramov
  committed
  8fa4939
- Adding placeholder for transfer to beegfs
  davramov
  committed
  b596ea0
- reorganizing config.yml to be in numerical order by beamline number
  davramov
  committed
  1f6d976
- Adding placeholder for 9.3.1 scicat ingestion
  davramov
  committed
  11a185e
- removing config from the schedule_prefect_flow call due to serialization
  davramov
  committed
  87b11dc
- copy data to beegfs as part of the flow
  davramov
  committed
  ac14b71
- Updating 931 pytest to check for two transfers (1 to beegfs, another to NERSC)
  davramov
  committed
  a2590c4

Navigation Menu

Repository navigation

9.3.1 Flows - #86

9.3.1 Flows#86
davramov wants to merge 28 commits into
als-computing:mainfrom
davramov:flow-931

Commits on Jan 14, 2026

init commit for bl 9.3.1

Adjusting 9.3.1 endpoint configuration to use the compute-dtn globus collection

Adding pytests for bl931 flows

Making Config931 optional, since it is initialized within the methods if it is set to None

Adding documentation for bl 9.3.1 flows

changing the data description in the documentation

Making the move flow call the move task, and updating the pytest/dispatcher/prefect.yaml reflect the change

Adjusting endpoint names in the test movement flow

Ensuring get_run_logger() is set in the flight check

if the transfer test fails, it should throw a runtime error

updating init_work_pools to handle when beamline id is a number (e.g. 733 -> bl733 is the folder name) or a word (dichroism -> dichroism is the folder name)

adjusting the test directory path for 931

Pinning fastapi==0.116.1; breaks with fastapi==0.124.0

Switching JSON Blocks to Variable Blocks

Adding flow diagram to 9.3.1 documentation

Updating flight scheck to move globus_test/test.txt

removing commented out code

adding _sync=True to Variable.get() call and added missing flow_run_name from schedule_prefect_flow

Adding verbose logging to process_new_931_file_task

Adding transfer_success RuntimeError if False

Fixing the deployment name when scheduling prune_globus_endpoint

Adding beegfs endpoint for 931

Adding placeholder for transfer to beegfs

reorganizing config.yml to be in numerical order by beamline number

Adding placeholder for 9.3.1 scicat ingestion

removing config from the schedule_prefect_flow call due to serialization

copy data to beegfs as part of the flow

Updating 931 pytest to check for two transfers (1 to beegfs, another to NERSC)