Skip to content

Pull requests: vllm-project/vllm

New pull request New
377 Open 4,498 Closed
377 Open 4,498 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Model] Support Mantis(LLaVA) model ci/build documentation Improvements or additions to documentation
#10711 opened Nov 27, 2024 by DarkLight1337 • Draft
1
1
[Bugfix][Mamba] Fix Multistep on Mamba-like models ready ONLY add when PR is ready to merge/full CI is needed
#10705 opened Nov 27, 2024 by mzusman Loading…
1
5
[WIP][CI]add genai-perf benchmark in nightly benchmark ci/build
#10704 opened Nov 27, 2024 by jikunshang Loading…
1
[Doc] Update model in arch_overview.rst to match comment documentation Improvements or additions to documentation
#10701 opened Nov 27, 2024 by spacewander Loading…
1
[V1] Initial support of multimodal models for V1 re-arch
#10699 opened Nov 27, 2024 by ywang96 • Draft
1 of 4 tasks
1
[ci] fix slow tests
#10698 opened Nov 27, 2024 by youkaichao Loading…
1
[V1] get_computed_blocks avoids recompute
#10695 opened Nov 27, 2024 by Abatom Loading…
9
[Model] support bitsandbytes quantization with minicpm3 model
#10682 opened Nov 27, 2024 by zixuanzhang226 Loading…
3
[WIP] Adding min tokens/repetition/presence/frequence penalties to V1 sampler
#10681 opened Nov 26, 2024 by sroy745 • Draft
1
[3/N] Support and implement merged input processor for LLaVA model
#10676 opened Nov 26, 2024 by DarkLight1337 Loading…
8
[Bugfix] Fix GGUF inference with FP16 unquantized checkpoint ready ONLY add when PR is ready to merge/full CI is needed
#10675 opened Nov 26, 2024 by Isotr0py Loading…
1
5
[Doc] Add github links for source code references documentation Improvements or additions to documentation
#10672 opened Nov 26, 2024 by russellb Loading…
5
[v1][WIP] Metrics & Stats prototype
#10651 opened Nov 26, 2024 by rickyyx • Draft
8
[Core] Integrate Fastsafetensor loader for loading model weights ci/build documentation Improvements or additions to documentation
#10647 opened Nov 26, 2024 by manish-sethi • Draft
1
[V1] VLM - Support running the mm_mapper preprocessor in the frontend process frontend needs-rebase
#10640 opened Nov 25, 2024 by alexm-neuralmagic Loading…
@alexm-neuralmagic
15
[Frontend] don't block event loop in tokenization (preprocess) in OpenAI compatible server frontend
#10635 opened Nov 25, 2024 by tomeras91 Loading…
21
[Misc] Allow LoRA to adaptively increase rank and remove possible_max_ranks
#10623 opened Nov 25, 2024 by JinhyunBang Loading…
5
[core] improve cpu offloading implementation
#10609 opened Nov 24, 2024 by youkaichao • Draft
6
[Core][Bugfix] Use correct device to initialize GPU data during CUDA-graph-capture
#10608 opened Nov 24, 2024 by IdoAsraff Loading…
1
[fix] Correct num_accepted_tokens counting ready ONLY add when PR is ready to merge/full CI is needed
#10604 opened Nov 24, 2024 by KexinFeng Loading…
5
[Interleaved ATTN] Support for Mistral-8B
#10591 opened Nov 23, 2024 by patrickvonplaten Loading…
6
[WIP] V1 LoRA support needs-rebase
#10579 opened Nov 22, 2024 by varun-sundar-rabindranath • Draft
5
[Core] Update to outlines > 0.1.4 ci/build
#10576 opened Nov 22, 2024 by russellb • Draft
3
[ Kernels ] [ AMD ] Add Fused MoE Configs
#10574 opened Nov 22, 2024 by robertgshaw2-neuralmagic • Draft
1
[Hardware][Intel-Gaudi] Enable LoRA support for Intel Gaudi (HPU)
#10565 opened Nov 22, 2024 by SanjuCSudhakaran Loading…
5
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.