Skip to content

OASIS send/receive calls blocked by eCLM history file saving #152

Closed

Description

@kvrigor

@s-poll noticed that OASIS spends around 60s on a 10-node eCLM-ICON runs, and this gets worse as the node count is increased (note the orange bars below).

Image

oasis_send should be called as soon as all required fields are computed; similarly oasis_receive should be moved much closer to the subroutine that needs the fields. Currently, oasis_send/oasis_receive are invoked outside the main eCLM driver routine:

#ifdef COUP_OAS_PFL
call oas_receive(bounds, time_elapsed, atm2lnd_inst)
#endif
! Run clm
call t_barrierf('sync_clm_run1', mpicom)
call t_startf ('clm_run')
call t_startf ('shr_orb_decl')
calday = get_curr_calday()
call shr_orb_decl( calday , eccen, mvelpp, lambm0, obliqr, declin , eccf )
call shr_orb_decl( nextsw_cday, eccen, mvelpp, lambm0, obliqr, declinp1, eccf )
call t_stopf ('shr_orb_decl')
call clm_drv(doalb, nextsw_cday, declinp1, declin, rstwr, nlend, rdate, rof_prognostic)
call t_stopf ('clm_run')
#if defined(COUP_OAS_ICON)
call oas_send_icon(bounds, time_elapsed, lnd2atm_inst)
#endif
#if defined(COUP_OAS_PFL)
call oas_send(bounds, time_elapsed, lnd2atm_inst)
#endif

Minimizing send/receive blocking is a good MPI practice; thus the OASIS calls need to be relocated to reduce coupling time. Non-blocking history file saving could further reduce OASIS delays, but this should be pursued separately and within the context of improving eCLM file I/O behavior.

Activity

  1. added
    coupled-parflowIssues related to eCLM-ParFlow coupling
    coupled-ICONIssues related to eCLM-ICON coupling
    on Oct 23, 2026
  2. kvrigor commented on Oct 23, 2026

    @kvrigor
    MemberAuthor

    I'll start working on this after eCLM-ICON changes have been merged to master. (#151).

  3. self-assigned this
    on Oct 23, 2026
  4. pinned this issue on Oct 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

coupled-ICONIssues related to eCLM-ICON couplingcoupled-parflowIssues related to eCLM-ParFlow coupling

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions