Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

torch distributed: add support for user-specified parameter synchronization #1612

Open
wants to merge 7 commits into
base: master
Choose a base branch
from
Open

torch distributed: add support for user-specified parameter synchronization #1612

wants to merge 7 commits into from

Commits on Sep 4, 2024

  1. torch distributed: add support for user-specified parameter synchroni… 

    …zation
    @NeoLegends
    NeoLegends committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    e852396 View commit details
    Browse the repository at this point in the history

  2. introduce helper function for fwd compat kwargs

    @NeoLegends
    NeoLegends committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    17b5a30 View commit details
    Browse the repository at this point in the history

  3. remove parameter, must be defined on subclass instead

    @NeoLegends
    NeoLegends committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    b5f28f4 View commit details
    Browse the repository at this point in the history

  4. work around faulty lint

    @NeoLegends
    NeoLegends committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    ccf6fa8 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. chore: Simplify implementation to support only callback

    @NeoLegends
    NeoLegends committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    e106103 View commit details
    Browse the repository at this point in the history

  2. fix text

    @NeoLegends
    NeoLegends committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    4540bdd View commit details
    Browse the repository at this point in the history

  3. remove torch.no_grad() for more flexibility

    @NeoLegends
    NeoLegends committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    d666d33 View commit details
    Browse the repository at this point in the history