Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on Mar 26, 2025

• [misc] LoRA - Skip LoRA kernels when not required (#15152)

  Show description for 6c663df
  

  varun-sundar-rabindranath

  and

  Varun Sundar Rabindranath

  authored
  6c663df

  Copy full SHA for 6c663df

• [BugFix] Fix nightly MLA failure (FA2 + MLA chunked prefill, i.e. V1, producing bad results) (#15492)

  Show description for 33437bc
  LucasWilkinson

  authored
  33437bc

  Copy full SHA for 33437bc

• [Misc] Warn about v0 in benchmark_paged_attn.py (#15495)

  Show description for 23114d3
  tlrmchlsmth

  authored
  23114d3

  Copy full SHA for 23114d3

• [Model] Support multi-image for Molmo (#15438)

  Show description for 997c881
  DarkLight1337

  authored
  997c881

  Copy full SHA for 997c881

• Transformers backend already supports V1 (#15463)

  Show description for e42389f
  hmellor

  authored
  e42389f

  Copy full SHA for e42389f

• [CI/Build] LoRA: Delete long context tests (#15503)

  Show description for ff38f0a
  

  varun-sundar-rabindranath

  and

  Varun Sundar Rabindranath

  authored
  ff38f0a

  Copy full SHA for ff38f0a

Commits on Mar 25, 2025

• [Core] LoRA: V1 Scheduler optimization (#15422)

  Show description for a5cfbab
  

  varun-sundar-rabindranath

  and

  Varun Sundar Rabindranath

  authored
  a5cfbab

  Copy full SHA for a5cfbab

• [core] add bucket padding to tpu_model_runner (#14995)

  Show description for ac3cd6e
  

  Chenyaaang

  and

  robertgshaw2-redhat

  authored
  ac3cd6e

  Copy full SHA for ac3cd6e

• [V1] Support long_prefill_token_threshold in v1 scheduler (#15419)

  Show description for 082ab86
  houseroad

  authored
  082ab86

  Copy full SHA for 082ab86

• [V1][Minor] Use `SchedulerInterface` type for engine scheduler field (#15499)

  Show description for 6aa196c
  njhill

  authored
  6aa196c

  Copy full SHA for 6aa196c

• [TPU][V1] Fix Sampler recompilation (#15309)

  Show description for a0dd7dc
  NickLucche

  authored
  a0dd7dc

  Copy full SHA for a0dd7dc

• Add workaround for shared field_names in pydantic model class (#13925)

  Show description for e977c11
  maxdebayser

  authored
  e977c11

  Copy full SHA for e977c11

• [bugfix] add supports_v1 platform interface (#15417)

  Show description for 5f063a8
  joerunde

  authored
  5f063a8

  Copy full SHA for 5f063a8

• [Bugfix] Support triton==3.3.0+git95326d9f for RTX 5090 (Unsloth + vLLM compatibility) (#15471)

  Show description for 5d8e1c9
  

  oteroantoniogom

  and

  ServerAI

  authored
  5d8e1c9

  Copy full SHA for 5d8e1c9

• [CI/Build] Add tests for the V1 tpu_model_runner. (#14843)

  Show description for 0a049c7
  yarongmu-google

  authored
  0a049c7

  Copy full SHA for 0a049c7

• [bugfix] fix inductor cache on max_position_embeddings (#15436)

  Show description for d0cfec7
  youkaichao

  authored
  d0cfec7

  Copy full SHA for d0cfec7

• [Kernel] Fix conflicting macro names for gguf kernels (#15456)

  Show description for a608160
  SzymonOzog

  authored
  a608160

  Copy full SHA for a608160

• [Doc] Update V1 user guide for multi-modality (#15460)

  Show description for 3f04a7f
  DarkLight1337

  authored
  3f04a7f

  Copy full SHA for 3f04a7f

• [Misc] Remove redundant `num_embeds` (#15443)

  Show description for 5994430
  DarkLight1337

  authored
  5994430

  Copy full SHA for 5994430

• [Misc] Clean up MiniCPM-V/O code (#15337)

  Show description for a9e879b
  DarkLight1337

  authored
  a9e879b

  Copy full SHA for a9e879b

• Dockerfile.ppc64le changes to move to UBI (#15402)

  Show description for 3e2f37a
  Shafi-Hussain

  authored
  3e2f37a

  Copy full SHA for 3e2f37a

• [Kernel][CPU] CPU MLA (#14744)

  Show description for 4f044b1
  gau-nernst

  authored
  4f044b1

  Copy full SHA for 4f044b1

• [Hardware][TPU][Bugfix] Fix v1 mp profiler (#15409)

  Show description for 4157f56
  lsy323

  authored
  4157f56

  Copy full SHA for 4157f56

• Fix CUDA kernel index data type in vllm/csrc/quantization/gptq_marlin/awq_marlin_repack.cu +10 (#15160)

  Show description for 051da7e
  

  houseroad

  and

  r-barnes

  authored
  051da7e

  Copy full SHA for 051da7e

• [V1][Spec Decode] Update target_logits in place for rejection sampling (#15427)

  Show description for 25f560a
  WoosukKwon

  authored
  25f560a

  Copy full SHA for 25f560a

• [V1] guidance backend for structured output + `auto` fallback mode (#14779)

  Show description for a09ad90
  

  3 peopleauthored
  a09ad90

  Copy full SHA for a09ad90

• [Bugfix] Fixed the issue of not being able to input video and image simultaneously (#15387)

  Show description for 10b34e3
  chaunceyjiang

  authored
  10b34e3

  Copy full SHA for 10b34e3

• Revert "Fix non-contiguous input passed to Marlin kernel (#15319)" (#15398)

  tlrmchlsmth

  authored
  b5269db

  Copy full SHA for b5269db

• [Misc] Remove LoRA log (#15388)

  Show description for 6db9457
  jeejeelee

  authored
  6db9457

  Copy full SHA for 6db9457

• Add pipeline parallel support to `TransformersModel` (#12832)

  Show description for 97cfa65
  

  hmellor

  and

  Isotr0py

  authored
  97cfa65

  Copy full SHA for 97cfa65

• [Minor][Spec Decode] Remove compiled_softmax (#15416)

  Show description for 911c8eb
  WoosukKwon

  authored
  911c8eb

  Copy full SHA for 911c8eb

• [V1][Spec Decode] Enable spec decode for top-p & top-k sampling (#15063)

  Show description for ebcebee
  WoosukKwon

  authored
  ebcebee

  Copy full SHA for ebcebee

Commits on Mar 24, 2025

• [ROCm][Kernel] MoE weights padding (#14454)

  Show description for f533b58
  

  gshtras

  and

  charlifu

  authored
  f533b58

  Copy full SHA for f533b58

• [Build] Cython compilation support fix (#14296)

  Show description for 8279201
  gshtras

  authored
  8279201

  Copy full SHA for 8279201

• [Hardware][TPU] Skip failed compilation test (#15421)

  Show description for 23fdab0
  lsy323

  authored
  23fdab0

  Copy full SHA for 23fdab0