Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add prefill 8B f16 torch sdpa test, update tests with compile flags and tp flags, with nightly iree #456

Open
wants to merge 10 commits into
base: main
Choose a base branch
from
Open

Add prefill 8B f16 torch sdpa test, update tests with compile flags and tp flags, with nightly iree #456

wants to merge 10 commits into from

Commits on Nov 16, 2024

  1. Update tests with compile flags and tp flags, try nightly iree 

    Signed-off-by: aviator19941 <[email protected]>
    @aviator19941
    aviator19941 committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    05fd409 View commit details
    Browse the repository at this point in the history

  2. Fix formatting, remove pdb 

    Signed-off-by: aviator19941 <[email protected]>
    @aviator19941
    aviator19941 committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    d951b7f View commit details
    Browse the repository at this point in the history

  3. Update CI comments and args in tests 

    Signed-off-by: aviator19941 <[email protected]>
    @aviator19941
    aviator19941 committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    ebd10d8 View commit details
    Browse the repository at this point in the history

  4. Add non-decomposed 8b f16 prefill only test nightly 

    Signed-off-by: aviator19941 <[email protected]>
    @aviator19941
    aviator19941 committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    1fe6987 View commit details
    Browse the repository at this point in the history

  5. Update preprocess pass compile flag 

    Signed-off-by: aviator19941 <[email protected]>
    @aviator19941
    aviator19941 committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    90e2601 View commit details
    Browse the repository at this point in the history

  6. Update iree nightly, add prefill torch sdpa test 

    Signed-off-by: aviator19941 <[email protected]>
    @aviator19941
    aviator19941 committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    825b8ff View commit details
    Browse the repository at this point in the history

  7. Get nightly iree, keep iree-turbine numpy 

    Signed-off-by: aviator19941 <[email protected]>
    @aviator19941
    aviator19941 committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    1547655 View commit details
    Browse the repository at this point in the history

  8. Update iree packages to nightly, fix name of test, create README 

    Signed-off-by: aviator19941 <[email protected]>
    @aviator19941
    aviator19941 committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    0510450 View commit details
    Browse the repository at this point in the history

  9. Fix pytest option dest and missed merge conflict 

    Signed-off-by: aviator19941 <[email protected]>
    @aviator19941
    aviator19941 committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    9b3f92a View commit details
    Browse the repository at this point in the history

  10. Move --skip-decode to model cli helper 

    Signed-off-by: aviator19941 <[email protected]>
    @aviator19941
    aviator19941 committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    2244b9e View commit details
    Browse the repository at this point in the history