You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
eCLM-ICON: Disable internal data atmosphere model (DATM) when coupled to ICON #120
The data atmosphere model (DATM) is necessary when running standalone eCLM simulations, but not when eCLM is coupled with ICON. ICON supplies the upper boundary conditions to eCLM; thus running DATM alongside ICON doesn't make sense and just burns CPU cycles. This issue was initially raised by @s-poll.
@mvhulten extensively hacked on the src/datm code tree to see if the DATM streams file I/O could be completely disabled. Bypassing DATM proved to be more difficult than expected. Marco's debugging notes are logged here.
Reacted by Ana Gonzalez-Nicolas and Marco van Hulten
changed the title [-]eCLM-ICON: Disable atmosphere model (`datm`) when coupled to ICON[/-][+]eCLM-ICON: Disable atmosphere model when coupled to ICON[/+]on Jun 18, 2026
changed the title [-]eCLM-ICON: Disable atmosphere model when coupled to ICON[/-][+]eCLM-ICON: Disable internal data atmosphere model (DATM) when coupled to ICON[/+]on Jun 18, 2026
A graphic from @s-poll's recent eCLM-ICON EU-3 runs show 11% (6 nodes) up to 24% overhead (16 nodes) from the DATM file I/O. Note the purple bars which show the DATM overhead runtime. Clearly these extra seconds should be shaved.
@kvrigor indeed, those overheads seem low hanging fruit to reduce runtime. However, what I find really annoying is the pink part, which, from the label, seems to be IO too... is it? This is roughly 2.5x the computations. That is therefore a major bottleneck.
@DCaviedesV indeed the slow I/O is annoying; it just shows that we haven't fully exploited the Parallel I/O library features in CLM5/eCLM. I will document the I/O investigation and fixes in #82
Activity
[-]eCLM-ICON: Disable atmosphere model (`datm`) when coupled to ICON[/-][+]eCLM-ICON: Disable atmosphere model when coupled to ICON[/+][-]eCLM-ICON: Disable atmosphere model when coupled to ICON[/-][+]eCLM-ICON: Disable internal data atmosphere model (DATM) when coupled to ICON[/+]kvrigor commentedon Oct 23, 2026
A graphic from @s-poll's recent eCLM-ICON EU-3 runs show 11% (6 nodes) up to 24% overhead (16 nodes) from the DATM file I/O. Note the purple bars which show the DATM overhead runtime. Clearly these extra seconds should be shaved.
DCaviedesV commentedon Oct 26, 2026
@kvrigor indeed, those overheads seem low hanging fruit to reduce runtime. However, what I find really annoying is the pink part, which, from the label, seems to be IO too... is it? This is roughly 2.5x the computations. That is therefore a major bottleneck.
kvrigor commentedon Oct 27, 2026
@DCaviedesV indeed the slow I/O is annoying; it just shows that we haven't fully exploited the Parallel I/O library features in CLM5/eCLM. I will document the I/O investigation and fixes in #82