Skip to content

Split reverse mode for mutating functions is full of traps #142

Closed

Description

@gdalle

The only backends concerned by this are AutoEnzyme(Enzyme.ReverseModeSplit) and AutoTapir.

For mutating functions, it is dangerous to interrupt reverse mode autodiff after the forward sweep. The variables are in an intermediate state which will only be reverted after the reverse sweep completes.

In particular, Tapir requires running another forward sweep between reverse sweep, so a pullback closure would be useless.

I'm not sure how split reverse Enzyme works, will have to investigate.

Related:

Activity

  1. added
    backendRelated to one or more autodiff backends
    coreRelated to the core utilities of the package
    on Apr 6, 2024
  2. locked and limited conversation to collaborators on Jan 17, 2025
  3. converted this issue into a discussion #678 on Jan 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    backendRelated to one or more autodiff backendscoreRelated to the core utilities of the package

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions