Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add gradient accumulation scheduler #21

Merged
merged 22 commits into from
Apr 18, 2024
Merged

Add gradient accumulation scheduler #21

merged 22 commits into from
Apr 18, 2024

Commits on Mar 29, 2024

  1. add dynamic gradient accumulation callback

    @MenuaB
    MenuaB committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    112c07c View commit details
    Browse the repository at this point in the history

  2. add dynamic gradient accumulation callback

    @MenuaB
    MenuaB committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    87e82d7 View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2024

  1. add dynamic gradient accumulation callback

    @MenuaB
    MenuaB committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    e5ae159 View commit details
    Browse the repository at this point in the history

  2. update environment requirements

    @MenuaB
    MenuaB committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    7782b1f View commit details
    Browse the repository at this point in the history

  3. minor dynamic changes for gemma run

    @MenuaB
    MenuaB committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    0e524a0 View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2024

  1. Merge branch 'main' into add_gradient_accumulation_scheduler

    @MenuaB
    MenuaB committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    677b052 View commit details
    Browse the repository at this point in the history

  2. minor changes prepare for run

    @MenuaB
    MenuaB committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    a1ff599 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2024

  1. add grad accumulation tracking in aim

    @MenuaB
    MenuaB committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    214f551 View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2024

  1. minor changes for new run

    @MenuaB
    MenuaB committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    3a2bb59 View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2024

  1. minor changes

    @MenuaB
    MenuaB committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    b5d5baa View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2024

  1. add dataset playground notebook

    @MenuaB
    MenuaB committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    7f5f38d View commit details
    Browse the repository at this point in the history

  2. update model configs

    @MenuaB
    MenuaB committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    2a679b6 View commit details
    Browse the repository at this point in the history

  3. add grad acc configs, move grad acc to step begin

    @MenuaB
    MenuaB committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    5e31dde View commit details
    Browse the repository at this point in the history

  4. back to defaults

    @MenuaB
    MenuaB committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    90e8f5d View commit details
    Browse the repository at this point in the history

  5. back to defaults

    @MenuaB
    MenuaB committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    b74c0d1 View commit details
    Browse the repository at this point in the history

  6. update conda env file

    @MenuaB
    MenuaB committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    22e852e View commit details
    Browse the repository at this point in the history

  7. minor changes

    @MenuaB
    MenuaB committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    d49c562 View commit details
    Browse the repository at this point in the history

  8. minor changes

    @MenuaB
    MenuaB committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    8c1b7fe View commit details
    Browse the repository at this point in the history

  9. minor changes

    @MenuaB
    MenuaB committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    860e50c View commit details
    Browse the repository at this point in the history

  10. add test status

    @MenuaB
    MenuaB committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    ee31a60 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. fix dynamic grad acc bug, fix PR issues

    @MenuaB
    MenuaB committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    658125d View commit details
    Browse the repository at this point in the history

  2. add test status

    @MenuaB
    MenuaB committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    6ad0bc1 View commit details
    Browse the repository at this point in the history