Upstream pr v0130#7
Draft
tjtanaa wants to merge 276 commits into
Draft
Conversation
… (#29125) Signed-off-by: yewentao256 <zhyanwentao@126.com>
…% TPOT improvemnt (#30159) Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: zhewenli <zhewenli@meta.com> Signed-off-by: Zhewen Li <zhewenli@meta.com>
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
…ocess hang (#30209) Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: gnovack <gnovack@amazon.com>
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
…ers backend (#30287) Signed-off-by: mgoin <mgoin64@gmail.com> Signed-off-by: Michael Goin <mgoin64@gmail.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Signed-off-by: Angel Li <liangel@meta.com>
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
…MoE) by allowing Sideload Parameters (#30116) Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com> Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Yongtao Huang <yongtaoh2022@gmail.com>
…e)` support padding (#29644) Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com> Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io> Signed-off-by: wang.yuqi <noooop@126.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
… (#30309) Signed-off-by: FENP <yuanyongjie.yyj@antgroup.com>
…s using single-token reasoning endings. (#30056)
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Signed-off-by: quanliu <18646313696@163.com> Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
…` (#30173) Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
…atrix multiplication available but not enabled` (#29897) Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
… args (#30708) Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
…s (#30529) Signed-off-by: Kevin Musgrave <kevin.musgrave@gmail.com> Signed-off-by: Michael Goin <mgoin64@gmail.com> Co-authored-by: Michael Goin <mgoin64@gmail.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
…logic (#29873) Signed-off-by: shen-shanshan <467638484@qq.com> Co-authored-by: gcanlin <canlinguosdu@gmail.com> Co-authored-by: TJian <tunjian.tan@embeddedllm.com> (cherry picked from commit 3bd9c491583d45ae9f3f24b10e99626f502014b4)
…731) Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> (cherry picked from commit e94384bbadbaf99dea24c4af4de6a8c897f830e7)
…782) Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> (cherry picked from commit 4de08ad698674560be7abebd9437d698d1216872)
…s only (#30475) Signed-off-by: Roger Wang <hey@rogerw.io> Co-authored-by: Sun Kim <sunytokki@gmail.com> (cherry picked from commit f5f51e5931ffd99afe69696b60765b88d3eb13f2)
Signed-off-by: yewentao256 <zhyanwentao@126.com> (cherry picked from commit b6ec077e058e15e5b853793924e6643ec6c579aa)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com> (cherry picked from commit 2410132bb1f9faa5b252fad3f2b83dc926946b08)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk> (cherry picked from commit 00a8d7628c202f580d5230eaa7fe94338a0549f5)
Signed-off-by: jiang1.li <jiang1.li@intel.com> Signed-off-by: Li, Jiang <bigpyj64@gmail.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> (cherry picked from commit 0cd5353644d3d045ab33c7e8e19c182bfd7db911)
Signed-off-by: Yan Ma <yan.ma@intel.com> (cherry picked from commit 4f735babb7353987137b85ec0465e594e9ed1384)
…chat_streaming_audio` (#30878) Signed-off-by: NickLucche <nlucches@redhat.com> (cherry picked from commit 9ca8cb38fd68142627c9649756f1ddc5432c8b19)
…ut + DeepGEMM (#30899) (cherry picked from commit e3fc374a9a69dddb16885d810f1e28d3fdd39ebd)
(cherry picked from commit 74a1ac38b00a8cf502db085d1bbd77712cf47e41)
…(#30910) Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> (cherry picked from commit 30bb19a760d6d5e8c69b3a4c78c9cb7430872a61)
…tu 22.04 Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
…blocks (#30915) Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu> (cherry picked from commit 11a89cf95caaec8dec13fab1e8e3d64c9a852a08)
Signed-off-by: sarathc-cerebras <sarath.chandran@cerebras.net> Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com> (cherry picked from commit 28d15ab56bd9d3fd17010bc4abaeec06988f7887)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> (cherry picked from commit d2dc5dfc6ecafbd3d725c1c42dd019db2b1efd30)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> (cherry picked from commit 19c583398aec0ef2b9fe42ba020bc3c39e7e001f)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
|
👋 Hi! Thank you for contributing to the vLLM project. 💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels. Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run You ask your reviewers to trigger select CI tests on top of Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging. To run CI, PR reviewers can either: Add If you have any questions, please reach out to us on Slack at https://slack.vllm.ai. 🚀 |
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Purpose
Test Plan
Test Result
Essential Elements of an Effective PR Description Checklist
supported_models.mdandexamplesfor a new model.