Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Draft] Support Flash Attention #501

Draft
wants to merge 5 commits into
base: dev
Choose a base branch
from
Draft

[Draft] Support Flash Attention #501

wants to merge 5 commits into from

Commits on Jan 30, 2024

  1. add flash attn mvp

    @cmathw
    cmathw committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    218e594 View commit details
    Browse the repository at this point in the history

  2. formatting

    @cmathw
    cmathw committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    187180e View commit details
    Browse the repository at this point in the history

  3. mark fast_attn tests skip if no gpu

    @cmathw
    cmathw committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    ab586a4 View commit details
    Browse the repository at this point in the history

  4. fix model fixture definition

    @cmathw
    cmathw committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    49357ae View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. Merge branch 'dev' into flash-attention

    @bryce13950
    bryce13950 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    90dd684 View commit details
    Browse the repository at this point in the history