Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Experimental] Scaled Dot Product Attention FlashAttention Algorithm Conversion #147

Open
yifeizh2 opened this issue Jul 3, 2024 · 1 comment · May be fixed by #131
Open

[Experimental] Scaled Dot Product Attention FlashAttention Algorithm Conversion #147

yifeizh2 opened this issue Jul 3, 2024 · 1 comment · May be fixed by #131
Assignees
@yifeizh2
Milestone
0.1 CPU - General

Comments

@yifeizh2
Copy link
Contributor

yifeizh2 commented Jul 3, 2024

Utilize flash attention algorithm to optimize the performance of attention
@yifeizh2 yifeizh2 added this to the Functional llama2 milestone Jul 3, 2024
@yifeizh2 yifeizh2 linked a pull request Jul 3, 2024 that will close this issue
Transform: support sdpa to flash attention kernel conversion #131
Draft
3 tasks
@yifeizh2 yifeizh2 linked a pull request Jul 8, 2024 that will close this issue
Draft
3 tasks
@yifeizh2 yifeizh2 modified the milestones: Functional llama2, CPU Jul 9, 2024
@lmontigny
Copy link

support flash attention + python API

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@yifeizh2 yifeizh2

Labels
None yet
Projects
None yet
Milestone
0.1 CPU - General
Development

Successfully merging a pull request may close this issue.

Transform: support sdpa to flash attention kernel conversion intel/graph-compiler
2 participants
@lmontigny @yifeizh2