Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[MOE Quantization] Warn against "undercalibrated" modules #2262

Open
wants to merge 62 commits into
base: main
Choose a base branch
from
Open

[MOE Quantization] Warn against "undercalibrated" modules #2262

wants to merge 62 commits into from

Commits on Apr 8, 2024

  1. initial commit

    @dbogunowicz
    dbogunowicz committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    097bd79 View commit details
    Browse the repository at this point in the history

  2. update setup.py

    @dbogunowicz
    dbogunowicz committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    76970e3 View commit details
    Browse the repository at this point in the history

  3. Update setup.py

    @dbogunowicz
    dbogunowicz authored Apr 8, 2024
    Configuration menu
    Copy the full SHA
    bbf4b39 View commit details
    Browse the repository at this point in the history

  4. fix setup.py

    @dbogunowicz
    dbogunowicz committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    a272a30 View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2024

  1. move all config to sparsetensors

    Sara Adkins committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    c0d3ead View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into feature/damian/sparsetensors

    Sara Adkins committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    b3f7ff3 View commit details
    Browse the repository at this point in the history

  3. cleanup class name and comments

    Sara Adkins committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    a75f8da View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2024

  1. Merge branch 'main' into feature/damian/sparsetensors

    Sara Adkins authored Apr 16, 2024
    Configuration menu
    Copy the full SHA
    c5b897e View commit details
    Browse the repository at this point in the history

  2. initial implementation untested

    Sara Adkins committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    2c72ab1 View commit details
    Browse the repository at this point in the history

  3. fixing issues

    Sara Adkins committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    9174c1d View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2024

  1. add test script

    Sara Adkins committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    aa17e77 View commit details
    Browse the repository at this point in the history

  2. update perplexity test

    Sara Adkins committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    f1f114c View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. refactor to compressed-tensors

    @dbogunowicz
    dbogunowicz committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    bbbdcb9 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into feature/damian/sparsetensors

    @dbogunowicz
    dbogunowicz authored Apr 18, 2024
    Configuration menu
    Copy the full SHA
    5d9c7dd View commit details
    Browse the repository at this point in the history

  3. rename sparsetensors

    Sara Adkins committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    7a9f9e5 View commit details
    Browse the repository at this point in the history

  4. update setup

    Sara Adkins committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    fa43088 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2024

  1. Sa/model reload (#2250) 

    * working reload

* sparsegpt
    Sara Adkins authored Apr 19, 2024
    Configuration menu
    Copy the full SHA
    63266d8 View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2024

  1. Merge branch 'main' into sa/quant_mod_refactor

    Sara Adkins authored Apr 22, 2024
    Configuration menu
    Copy the full SHA
    b0f0fc9 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into feature/damian/sparsetensors

    Sara Adkins authored Apr 22, 2024
    Configuration menu
    Copy the full SHA
    dfa41fb View commit details
    Browse the repository at this point in the history

  3. Merge branch 'feature/damian/sparsetensors' into sa/quant_mod_refactor

    Sara Adkins committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    4af4852 View commit details
    Browse the repository at this point in the history

  4. cleanup

    Sara Adkins committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    55976c5 View commit details
    Browse the repository at this point in the history

  5. refactor tests

    Sara Adkins committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    38f4f77 View commit details
    Browse the repository at this point in the history

  6. only run oneshot once

    Sara Adkins committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    6574874 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. all tests passing

    @dbogunowicz
    dbogunowicz committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    7f5babf View commit details
    Browse the repository at this point in the history

  2. remove unused config

    @dbogunowicz
    dbogunowicz committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    c0d6cb9 View commit details
    Browse the repository at this point in the history

  3. reset models on each parameterize

    Sara Adkins committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    a59e2af View commit details
    Browse the repository at this point in the history

  4. Merge branch 'feature/damian/sparsetensors' into sa/quant_mod_refactor

    Sara Adkins committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    cba7c27 View commit details
    Browse the repository at this point in the history

  5. style

    Sara Adkins committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    2a6b0f2 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. Merge branch 'main' into feature/damian/sparsetensors

    @dbogunowicz
    dbogunowicz authored Apr 24, 2024
    Configuration menu
    Copy the full SHA
    1e7ee94 View commit details
    Browse the repository at this point in the history

  2. bring back SparsityConfigMetadata

    @dbogunowicz
    dbogunowicz committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    a4e0575 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'feature/damian/sparsetensors' of github.com:neuralmagic… 

    …/sparseml into feature/damian/sparsetensors
    @dbogunowicz
    dbogunowicz committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    06d4554 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/feature/damian/sparsetensors' in… 

    …to sa/quant_mod_refactor
    @dbogunowicz
    dbogunowicz committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    644da53 View commit details
    Browse the repository at this point in the history

  5. Update setup.py 

    Co-authored-by: Rahul Tuli <[email protected]>
    @dbogunowicz @rahul-tuli
    dbogunowicz and rahul-tuli authored Apr 24, 2024
    Configuration menu
    Copy the full SHA
    8ac18e7 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2024

  1. add more comparisons, tighten threshold

    Sara Adkins committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    de78247 View commit details
    Browse the repository at this point in the history

  2. use wikitext for perplexity

    Sara Adkins committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    4041f2e View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into feature/damian/sparsetensors

    @dbogunowicz
    dbogunowicz authored Apr 25, 2024
    Configuration menu
    Copy the full SHA
    f5adc4e View commit details
    Browse the repository at this point in the history

  4. update setup

    @dbogunowicz
    dbogunowicz committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    c220772 View commit details
    Browse the repository at this point in the history

  5. fix import problem

    @dbogunowicz
    dbogunowicz committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    2fe554e View commit details
    Browse the repository at this point in the history

  6. fix clearml test

    @dbogunowicz
    dbogunowicz committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    4e0413e View commit details
    Browse the repository at this point in the history

  7. compressed-tensors are transformers dep

    @dbogunowicz
    dbogunowicz committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    a98a193 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'feature/damian/sparsetensors' into sa/quant_mod_refactor

    Sara Adkins committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    b9b684c View commit details
    Browse the repository at this point in the history

  9. address PR comments

    Sara Adkins committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    f4362cf View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2024

  1. can't repeat freeze

    Sara Adkins committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    ca91c4f View commit details
    Browse the repository at this point in the history

  2. UX pr comments

    Sara Adkins committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    c894305 View commit details
    Browse the repository at this point in the history

Commits on May 1, 2024

  1. Merge branch 'main' into sa/quant_mod_refactor

    Sara Adkins authored May 1, 2024
    Configuration menu
    Copy the full SHA
    1c3b31b View commit details
    Browse the repository at this point in the history

  2. quality

    Sara Adkins committed May 1, 2024
    Configuration menu
    Copy the full SHA
    90795bd View commit details
    Browse the repository at this point in the history

  3. shape consistency

    @horheynm
    horheynm committed May 1, 2024
    Configuration menu
    Copy the full SHA
    bf7d0f6 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'sa/quant_mod_refactor' of github.com:neuralmagic/sparse… 

    …ml into sa/quant_mod_refactor
    @horheynm
    horheynm committed May 1, 2024
    Configuration menu
    Copy the full SHA
    579d201 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2024

  1. address PR comments

    Sara Adkins committed May 2, 2024
    Configuration menu
    Copy the full SHA
    2432cf4 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2024

  1. only relevant files

    @dbogunowicz
    dbogunowicz committed May 6, 2024
    Configuration menu
    Copy the full SHA
    139f388 View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. Merge remote-tracking branch 'origin/main' into feature/damian/moe

    @dbogunowicz
    dbogunowicz committed May 7, 2024
    Configuration menu
    Copy the full SHA
    b33e393 View commit details
    Browse the repository at this point in the history

  2. add checks for undercalibrated modules

    @dbogunowicz
    dbogunowicz committed May 7, 2024
    Configuration menu
    Copy the full SHA
    d70daa2 View commit details
    Browse the repository at this point in the history

  3. typo

    @dbogunowicz
    dbogunowicz committed May 7, 2024
    Configuration menu
    Copy the full SHA
    6a4eecb View commit details
    Browse the repository at this point in the history

  4. Delete moe.py

    @dbogunowicz
    dbogunowicz authored May 7, 2024
    Configuration menu
    Copy the full SHA
    7a82f56 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2024

  1. Merge branch 'main' into feature/damian/moe

    @dbogunowicz
    dbogunowicz authored May 10, 2024
    Configuration menu
    Copy the full SHA
    a264819 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. Merge branch 'main' into feature/damian/moe

    @dbogunowicz
    dbogunowicz authored May 13, 2024
    Configuration menu
    Copy the full SHA
    66b6cf7 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. Merge branch 'main' into feature/damian/moe

    @dbogunowicz
    dbogunowicz authored May 14, 2024
    Configuration menu
    Copy the full SHA
    c5fb319 View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. ready to hand over

    [email protected] committed May 15, 2024
    Configuration menu
    Copy the full SHA
    453a34c View commit details
    Browse the repository at this point in the history

  2. truncate the warning content

    [email protected] committed May 15, 2024
    Configuration menu
    Copy the full SHA
    92191e8 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. Merge branch 'main' into feature/damian/moe

    @dbogunowicz
    dbogunowicz authored May 16, 2024
    Configuration menu
    Copy the full SHA
    b859ff6 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. Merge remote-tracking branch 'origin/main' into feature/damian/moe

    [email protected] committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    de34285 View commit details
    Browse the repository at this point in the history

  2. refresh

    [email protected] committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    c385c68 View commit details
    Browse the repository at this point in the history