Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add prefill 8B f16 torch sdpa test, update tests with compile flags and tp flags, with nightly iree #456

Open
wants to merge 10 commits into
base: main
Choose a base branch
from
Open

Add prefill 8B f16 torch sdpa test, update tests with compile flags and tp flags, with nightly iree #456

wants to merge 10 commits into from
+116 −31

Conversation

aviator19941
Copy link
Collaborator

@aviator19941 aviator19941 commented Nov 8, 2024 •
edited
Loading

  1. Update tests with compile flags and tp flags, with nightly iree.
  2. Only use 8b f16 decomposed test to decrease the CI wait time.

ScottTodd
ScottTodd previously requested changes Nov 8, 2024
View reviewed changes
.github/workflows/ci-llama-large-tests.yaml Outdated Show resolved Hide resolved
sharktank/sharktank/utils/export_artifacts.py Outdated Show resolved Hide resolved
@aviator19941 aviator19941 force-pushed the update-ci-and-llama-flags branch 2 times, most recently from 9722977 to 2cd8640 Compare November 14, 2024 01:59
@aviator19941 aviator19941 changed the title Update tests with compile flags and tp flags, with nightly iree Add prefill torch sdpa test, update tests with compile flags and tp flags, with nightly iree Nov 14, 2024
@aviator19941 aviator19941 changed the title Add prefill torch sdpa test, update tests with compile flags and tp flags, with nightly iree Add prefill 8B f16 torch sdpa test, update tests with compile flags and tp flags, with nightly iree Nov 14, 2024
@ScottTodd ScottTodd dismissed their stale review November 14, 2024 02:57

unblock request changes

@aviator19941
Update tests with compile flags and tp flags, try nightly iree
05fd409 
Signed-off-by: aviator19941 <[email protected]>
@aviator19941
Fix formatting, remove pdb
d951b7f 
Signed-off-by: aviator19941 <[email protected]>
@aviator19941
Update CI comments and args in tests
ebd10d8 
Signed-off-by: aviator19941 <[email protected]>
@aviator19941
Add non-decomposed 8b f16 prefill only test nightly
1fe6987 
Signed-off-by: aviator19941 <[email protected]>
@aviator19941
Update preprocess pass compile flag
90e2601 
Signed-off-by: aviator19941 <[email protected]>
@aviator19941
Update iree nightly, add prefill torch sdpa test
825b8ff 
Signed-off-by: aviator19941 <[email protected]>
@aviator19941
Get nightly iree, keep iree-turbine numpy
1547655 
Signed-off-by: aviator19941 <[email protected]>
@aviator19941
Update iree packages to nightly, fix name of test, create README
0510450 
Signed-off-by: aviator19941 <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@marbre marbre marbre left review comments

@ScottTodd ScottTodd ScottTodd left review comments

@saienduri saienduri Awaiting requested review from saienduri

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@aviator19941 @ScottTodd @marbre