Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[do not merge] ibm-dev build ibm-20241014 #200

Open
wants to merge 199 commits into
base: main
Choose a base branch
from
Open

[do not merge] ibm-dev build ibm-20241014 #200

wants to merge 199 commits into from

Conversation

fialhocoelho
Copy link

PR to trigger the build process for a compiled image

ywang96 and others added 30 commits September 26, 2024 07:45
@ywang96
[Misc] Update config loading for Qwen2-VL and remove Granite (vllm-pr…
4bb98f2 
…oject#8837)
@tlrmchlsmth
[Build/CI] Upgrade to gcc 10 in the base build Docker image (vllm-pro…
f70bcca 
…ject#8814)
@mgoin
[Docs] Add README to the build docker image (vllm-project#8825)
520db4d
@fyuan1316
[CI/Build] Fix missing ci dependencies (vllm-project#8834)
68988d4
@youkaichao
[misc][installation] build from source without compilation (vllm-proj…
70de39f 
…ect#8818)
@khluu
[ci] Soft fail Entrypoints, Samplers, LoRA, Decoder-only VLM (vllm-pr…
d9cfbc8 
…oject#8872)

Signed-off-by: kevin <[email protected]>
@Pernekhan
[Bugfix] Include encoder prompts len to non-stream api usage response (…
93d364d 
…vllm-project#8861)
@mgoin
[Misc] Change dummy profiling and BOS fallback warns to log once (vll…
b28d210 
…m-project#8820)
@tlrmchlsmth
[Bugfix] Fix print_warning_once's line info (vllm-project#8867)
e2f6f26
@chiragjn
fix validation: Only set tool_choice auto if at least one tool is p…
ee2da3e 
…rovided (vllm-project#8568)
@tlrmchlsmth
[Bugfix] Fixup advance_step.cu warning (vllm-project#8815)
71d21c7
@njhill
[BugFix] Fix test breakages from transformers 4.45 upgrade (vllm-proj…
4b377d6 
…ect#8829)
@DarkLight1337
[Installation] Allow lower versions of FastAPI to maintain Ray 2.9 co…
1b49148 
…mpatibility (vllm-project#8764)
@maxdebayser
[Feature] Add support for Llama 3.1 and 3.2 tool use (vllm-project#8343)
344cd2b 
Signed-off-by: Max de Bayser <[email protected]>
@DarkLight1337
[Core] renamePromptInputs and inputs (vllm-project#8876)
3b00b9c
@youkaichao
[misc] fix collect env (vllm-project#8894)
dc4e3df
@panpan0000
[MISC] Fix invalid escape sequence '\' (vllm-project#8830)
0e08875 
Signed-off-by: Peter Pan <[email protected]>
@Isotr0py
[Bugfix][VLM] Fix Fuyu batching inference with max_num_seqs>1 (vllm…
6d792d2 
…-project#8892)
@bvrockwell
[TPU] Update pallas.py to support trillium (vllm-project#8871)
8df2dc3
@youkaichao
[torch.compile] use empty tensor instead of None for profiling (vllm-…
a9b15c6 
…project#8875)
@ProExpertProg
[Kernel] AQ AZP 4/4: Integrate asymmetric quantization to linear meth…
172d1cd 
…od (vllm-project#7271)
@LucasWilkinson @mgoin
[Bugfix] fix for deepseek w4a16 (vllm-project#8906)
c5d5535 
Co-authored-by: mgoin <[email protected]>
@varun-sundar-rabindranath
[Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (
c2ec430 
vllm-project#8378)

Co-authored-by: Varun Sundar Rabindranath <[email protected]>
@youkaichao
[misc][distributed] add VLLM_SKIP_P2P_CHECK flag (vllm-project#8911)
18e60d7
@schoennenbeck
[Core] Priority-based scheduling in async engine (vllm-project#8850)
bd429f2
@youkaichao
[misc] fix wheel name (vllm-project#8919)
d86f6b2
@tylertitsworth @youkaichao
[Bugfix][Intel] Fix XPU Dockerfile Build (vllm-project#7824)
260024a 
Signed-off-by: tylertitsworth <[email protected]>
Co-authored-by: youkaichao <[email protected]>
@DarkLight1337
[Misc] Remove vLLM patch of BaichuanTokenizer (vllm-project#8921)
b0298aa
@tastelikefeet
[Bugfix] Fix code for downloading models from modelscope (vllm-projec…
39d3f8d 
…t#8443)
@varun-sundar-rabindranath
[Bugfix] Fix PP for Multi-Step (vllm-project#8887)
19d02ff
sixsixcoder and others added 23 commits October 11, 2024 17:36
@sixsixcoder
[Model] Add GLM-4v support and meet vllm==0.6.2 (vllm-project#9242)
6cf1167
@homeffjy
[Doc] Remove outdated comment to avoid misunderstanding (vllm-project…
1a18238 
…#9287)
@wallashss
[Doc] Compatibility matrix for mutual exclusive features (vllm-projec…
8baf85e 
…t#8512)

Signed-off-by: Wallas Santos <[email protected]>
@LucasWilkinson
[Bugfix][CI/Build] Fix docker build where CUDA archs < 7.0 are being …
de9fb4b 
…detected (vllm-project#9254)
@allenwang28
[Bugfix] Sets is_first_step_output for TPUModelRunner (vllm-project…
c6cf929 
…#9202)
@prashantgupta24
[bugfix] fix f-string for error (vllm-project#9295)
d11b46f 
Signed-off-by: Prashant Gupta <[email protected]>
@maxdebayser
[BugFix] Fix tool call finish reason in streaming case (vllm-project#…
ec10cb8 
…9209)

Signed-off-by: Max de Bayser <[email protected]>
@LiuXiaoxuanPKU
[SpecDec] Remove Batch Expansion (2/3) (vllm-project#9298)
89feb4c
@xiangxu-google
[Bugfix] Fix bug of xformer prefill for encoder-decoder (vllm-project…
00298e0 
…#9026)
@cermeng @youkaichao
[Misc][Installation] Improve source installation script and doc (vllm…
2b184dd 
…-project#9309)

Co-authored-by: youkaichao <[email protected]>
@jeejeelee
[Bugfix]Fix MiniCPM's LoRA bug (vllm-project#9286)
250e26a
@LiuXiaoxuanPKU
[CI] Fix merge conflict (vllm-project#9317)
f519902
@tlrmchlsmth
[Bugfix] Bandaid fix for speculative decoding tests (vllm-project#9327)
16b24e7
@mrsalehi @sangho-vision @ywang96
[Model] Molmo vLLM Integration (vllm-project#9016)
dfe43a2 
Co-authored-by: sanghol <[email protected]>
Co-authored-by: Roger Wang <[email protected]>
Co-authored-by: Roger Wang <[email protected]>
@jikunshang
[Hardware][intel GPU] add async output process for xpu (vllm-project#…
4141608 
…8897)
@dtrifiro
[CI/Build] setuptools-scm fixes (vllm-project#8900)
203ab8f
@simon-mo
[Docs] Remove PDF build from Readtehdocs (vllm-project#9347)
fd47e57
@fialhocoelho
Merge branch 'main' of https://github.com/vllm-project/vllm into ibm-…
852d585 
…20241014

Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 199
b511b58 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 5733
5e95520 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 6357
a824e3c 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 9027
23d44d8 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 9034
363ce87 
Signed-off-by: Jefferson Fialho <[email protected]>
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Oct 14, 2024

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: fialhocoelho
Once this PR has been reviewed and has the lgtm label, please assign danielezonca for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Oct 14, 2024

@fialhocoelho: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/smoke-test 363ce87 link true /test smoke-test

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@openshift-merge-robot
Copy link

PR needs rebase.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dtrifiro dtrifiro Awaiting requested review from dtrifiro

@Xaenalt Xaenalt Awaiting requested review from Xaenalt

Assignees
No one assigned
Labels
do-not-merge/hold needs-rebase
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.