vLLM v0.4.0.post1stable Released Apr 02, 2024
Impact Score: 5/10

vLLM: v0.4.0.post1, restore sm70/75 support

Source available โ€” automated, not human-reviewed

Component: vllm ยท Channel: stable. Automated analysis, not a compatibility certification. How this works.

Analysis updated: 2026-11-01.

Compatibility not verified โ€” check source notes
๐Ÿ“„ .MD
โšก Executive Summary (TL;DR)

vLLM v0.4.0.post1. Source highlight: v0.4.0 lacks support for sm70/75 support. We did a hotfix for it.

Who Does This Impact? (Role-Based Analysis)

๐Ÿ’ป Software Engineers & Devs

Check the source notes against the package and APIs you use before upgrading.

๐Ÿ“Š Product & Engineering Leads

Use the documented changes to assess relevance to your product; release frequency alone is not a quality measure.

โš™๏ธ DevOps & Security

Verify the target version, runtime requirements and rollback procedure in the official documentation.

โœจ New Features & Capabilities (2)

  • [Misc] Add support for new autogptq checkpoint_format
  • [Hardware][Intel] Add CPU inference backend

โšก Performance & Enhancements (1)

  • [Kernel] Layernorm performance optimization

๐Ÿ”ง Bug Fixes & Patches (6)

  • [Misc] Minor fixes in requirements.txt
  • [Misc] Fix Benchmark TTFT Calculation for Chat Completions
  • [HotFix] [CI/Build] Minor fix for CPU backend CI
  • [Frontend][Bugfix] allow using the default middleware with a root path
  • [Doc] Fix vLLMEngine Doc Page
  • [CI/Build] fix TORCH_CUDA_ARCH_LIST in wheel build
๐Ÿ“„ View Raw Release Notes (Original Developer Log)
## Highlight v0.4.0 lacks support for sm70/75 support. We did a hotfix for it. ## What's Changed * [Kernel] Layernorm performance optimization by @mawong-amd in https://github.com/vllm-project/vllm/pull/3662 * [Doc] Update installation doc for build from source and explain the dependency on torch/cuda version by @youkaichao in https://github.com/vllm-project/vllm/pull/3746 * [CI/Build] Make Marlin Tests Green by @robertgshaw2-neuralmagic in https://github.com/vllm-project/vllm/pull/3753 * [Misc] Minor fixes in requirements.txt by @WoosukKwon in https://github.com/vllm-project/vllm/pull/3769 * [Misc] Some minor simplifications to detokenization logic by @njhill in https://github.com/vllm-project/vllm/pull/3670 * [Misc] Fix Benchmark TTFT Calculation for Chat Completions by @ywang96 in https://github.com/vllm-project/vllm/pull/3768 * [Speculative decoding 4/9] Lookahead scheduling for speculative decoding by @cadedaniel in https://github.com/vllm-project/vllm/pull/3250 * [Misc] Add support for new autogptq checkpoint_format by @Qubitium in https://github.com/vllm-project/vllm/pull/3689 * [Misc] [CI/Build] Speed up block manager CPU-only unit tests ~10x by opting-out of GPU cleanup by @cadedaniel in https://github.com/vllm-project/vllm/pull/3783 * [Hardware][Intel] Add CPU inference backend by @bigPYJ1151 in https://github.com/vllm-project/vllm/pull/3634 * [HotFix] [CI/Build] Minor fix for CPU backend CI by @bigPYJ1151 in https://github.com/vllm-project/vllm/pull/3787 * [Frontend][Bugfix] allow using the default middleware with a root path by @A-Mahla in https://github.com/vllm-project/vllm/pull/3788 * [Doc] Fix vLLMEngine Doc Page by @ywang96 in https://github.com/vllm-project/vllm/pull/3791 * [CI/Build] fix TORCH_CUDA_ARCH_LIST in wheel build by @youkaichao in https://github.com/vllm-project/vllm/pull/3801 * Fix crash when try torch.cuda.set_device in worker by @leiwen83 in https://github.com/vllm-project/vllm/pull/3770 * [Bugfix] Add `__init__.py` files for `vllm/core/block/` and `vllm/spec_decode/` by @mgoin in https://github.com/vllm-project/vllm/pull/3798 * [CI/Build] 0.4.0.post1, fix sm 7.0/7.5 binary by @youkaichao in https://github.com/vllm-project/vllm/pull/3803 ## New Contributors * @mawong-amd made their first contribution in https://github.com/vllm-project/vllm/pull/3662 * @Qubitium made their first contribution in https://github.com/vllm-project/vllm/pull/3689 * @bigPYJ1151 made their first contribution in https://github.com/vllm-project/vllm/pull/3634 * @A-Mahla made their first contribution in https://github.com/vllm-project/vllm/pull/3788 **Full Changelog**: https://github.com/vllm-project/vllm/compare/v0.4.0...v0.4.0.post1