Impact Score: 5/10
vLLM v0.3.2 — Release Notes & Engineering Impact
Source available — automated, not human-reviewed
Component: vllm · Channel: stable. Automated analysis, not a compatibility certification. How this works.
Analysis updated: 2026-11-01.
⚡ Executive Summary (TL;DR)
vLLM v0.3.2. Source highlight: This version adds support for the OLMo and Gemma Model, as well as `seed` parameter.
Who Does This Impact? (Role-Based Analysis)
💻 Software Engineers & Devs
Check the source notes against the package and APIs you use before upgrading.
📊 Product & Engineering Leads
Use the documented changes to assess relevance to your product; release frequency alone is not a quality measure.
⚙️ DevOps & Security
Verify the target version, runtime requirements and rollback procedure in the official documentation.
✨ New Features & Capabilities (5)
- Add code-revision config argument for Hugging Face Hub
- [Test] Add basic correctness test
- Add warning to prevent changes to benchmark api server
- Add metrics to RequestOutput
- Add Gemma model
🔧 Bug Fixes & Patches (4)
- [Minor] Small fix to make distributed init logic in worker looks cleaner
- Fix `vllm:prompt_tokens_total` metric calculation
- [FIX] Fix beam search test
- [FIX] Add Gemma model to the doc
📄 View Raw Release Notes (Original Developer Log)
## Major Changes
This version adds support for the OLMo and Gemma Model, as well as `seed` parameter.
## What's Changed
* Defensively copy `sampling_params` by @njhill in https://github.com/vllm-project/vllm/pull/2881
* multi-LoRA as extra models in OpenAI server by @jvmncs in https://github.com/vllm-project/vllm/pull/2775
* Add code-revision config argument for Hugging Face Hub by @mbm-ai in https://github.com/vllm-project/vllm/pull/2892
* [Minor] Small fix to make distributed init logic in worker looks cleaner by @zhuohan123 in https://github.com/vllm-project/vllm/pull/2905
* [Test] Add basic correctness test by @zhuohan123 in https://github.com/vllm-project/vllm/pull/2908
* Support OLMo models. by @Isotr0py in https://github.com/vllm-project/vllm/pull/2832
* Add warning to prevent changes to benchmark api server by @simon-mo in https://github.com/vllm-project/vllm/pull/2858
* Fix `vllm:prompt_tokens_total` metric calculation by @ronensc in https://github.com/vllm-project/vllm/pull/2869
* [ROCm] include gfx908 as supported by @jamestwhedbee in https://github.com/vllm-project/vllm/pull/2792
* [FIX] Fix beam search test by @zhuohan123 in https://github.com/vllm-project/vllm/pull/2930
* Make vLLM logging formatting optional by @Yard1 in https://github.com/vllm-project/vllm/pull/2877
* Add metrics to RequestOutput by @Yard1 in https://github.com/vllm-project/vllm/pull/2876
* Add Gemma model by @xiangxu-google in https://github.com/vllm-project/vllm/pull/2964
* Upgrade transformers to v4.38.0 by @WoosukKwon in https://github.com/vllm-project/vllm/pull/2965
* [FIX] Add Gemma model to the doc by @zhuohan123 in https://github.com/vllm-project/vllm/pull/2966
* [ROCm] Upgrade transformers to v4.38.0 by @WoosukKwon in https://github.com/vllm-project/vllm/pull/2967
* Support per-request seed by @njhill in https://github.com/vllm-project/vllm/pull/2514
* Bump up version to v0.3.2 by @zhuohan123 in https://github.com/vllm-project/vllm/pull/2968
## New Contributors
* @jvmncs made their first contribution in https://github.com/vllm-project/vllm/pull/2775
* @mbm-ai made their first contribution in https://github.com/vllm-project/vllm/pull/2892
* @Isotr0py made their first contribution in https://github.com/vllm-project/vllm/pull/2832
* @jamestwhedbee made their first contribution in https://github.com/vllm-project/vllm/pull/2792
**Full Changelog**: https://github.com/vllm-project/vllm/compare/v0.3.1...v0.3.2