Skip to content

Pull requests: HabanaAI/vllm-fork

New pull request New
22 Open 403 Closed
22 Open 403 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[DO NOT MERGE] Upstream codebase diff
#470 opened Nov 6, 2024 by kzawora-intel • Draft
1
Add option to disable duplicates in topk
#464 opened Nov 6, 2024 by kdamaszk Loading…
[New Feature][Habana main] spec decode PR2 - Medusa, MLP, Eagle
#461 opened Nov 5, 2024 by xuechendi Loading…
4
AWQ Support
#458 opened Nov 4, 2024 by maktukmak Loading…
2
Dev/afierka/mss acc fix
#456 opened Nov 4, 2024 by afierka-intel • Draft
@afierka-intel
Config hidden layer number to run in 1 lazy graph
#451 opened Nov 1, 2024 by libinta Loading…
4
Add multi step scheduling scenario to jenkins CI
#445 opened Oct 30, 2024 by afierka-intel • Draft
to make repetition penalty faster
#442 opened Oct 29, 2024 by ccrhx4 Loading…
7
Add models-tiny CI step with Llama3.2-1B
#440 opened Oct 28, 2024 by kzawora-intel • Draft
Resolved alibi bias issue by reverting to PA v1.
#438 opened Oct 28, 2024 by tannervoas742 Loading…
1
Resolved alibi bias issue due to porting flat PA pr
#437 opened Oct 28, 2024 by tannervoas742 Loading…
1
Add HPU information to collect_env script
#430 opened Oct 25, 2024 by michalkuligowski Loading…
1
GPTQ Support
#421 opened Oct 23, 2024 by maktukmak Loading…
20
[PoC] Add max padding ratio to padding aware scheduler
#407 opened Oct 18, 2024 by kzawora-intel • Draft
Create run-lm-eval-mmlu.sh
#399 opened Oct 16, 2024 by michalkuligowski • Draft
WA for OOM in qwen 2 - sync after loading weights
#398 opened Oct 16, 2024 by michalkuligowski Loading…
[bucketing overhaul 2/n] Delegate bucket management to HPUBucketingContext
#395 opened Oct 15, 2024 by kzawora-intel Loading…
1
fix hpu destructors flow and remove finish_measurements
#379 opened Oct 10, 2024 by nirda7 Loading…
5
[New Feature][Habana-Main] speculative_decoding HPU support
#375 opened Oct 8, 2024 by xuechendi Loading…
25
Add bucket calibration, allow reading/writing bucketing configs to file
#345 opened Sep 27, 2024 by kzawora-intel Loading…
5
Optimize LoRA mask creation habana Issues or PRs submitted by Habana Labs
#285 opened Sep 13, 2024 by SanjuCSudhakaran • Draft
1
[build] Changes for RH build external Issues or PRs submitted by external users
#190 opened Aug 15, 2024 by Xaenalt Loading…
ProTip! no:milestone will show everything without a milestone.