# Hugging Face Transformers v5.16.0 — Release & Upgrade Intelligence
- **Product:** Hugging Face Transformers (https://huggingface.co)
- **Version:** v5.16.0
- **Released:** Aug 26, 2026
- **Impact Score:** 7/10
- **Breaking Changes:** Source flagged
- **Canonical Analysis:** https://changelogs.us/transformers/updates/v5.16.0/

## Executive Summary (TL;DR)
Hugging Face Transformers v5.16.0. Source highlight: Qwen4-Exp builds on Qwen3.5's hybrid text and multimodal architecture with three key components: GatedResidual (GR), Qwen Sparse Attention (QSA), and Per-Layer Embedding (PLE).

## Breaking Changes & Deprecations
- Breaking changes The legacy tensor-parallel implementation has been replaced with a DTensor-native backend, so users relying on the previous TP API for inference or training must migrate to the new DTensor-based interface.

## New Features
- Add Qwen4Exp model (#48337) by @Cyrilvallez in #48337
- Add Granite Speech 5.0 - (#48288) by @eustlb in #48288
- **Gated attention**: each attention layer adds an extra projection whose sigmoid output gates the attention output per head, before the output projection — the same *Gated Attention* mechanism used in Qwen3-Next. A subset of layers use fewer heads and a sliding window instead of full attention.
- Add CohereCompass modeling (#47878) by @calpt in #47878
- feat: add nvfp4 quantization (#47883) by @drbh in [#47883]
- Add an opt-in per-frame pixel cap (cap_pixels_per_frame) to the Qwen3-VL video processor (#48071)

## Bug Fixes
- **Dynamic image tiling**: instead of a fixed tile grid, the image processor picks its tiling window from each image's own aspect ratio, producing one downscaled global view plus zero or more local high-resolution crops per image.
- 🚨[wav2vec2] Support attn_implementation=sdpa dispatch (#46196)
- Cpmant fix use cache (#48013) by @jiqing-feng in [#48013]
- Fix Qwen2.5-Omni / Qwen3-Omni-MoE generation with a compilable cache (#47872) by @jiqing-feng in [#47872]
- Fix sliding window cache index off-by-one on wraparound (#47708) by @hameedibrh in [#47708]
- [Whisper] Fix speculative decoding: UnboundLocalError, cache corruption, and speed regression (#48000) by @ydshieh in [#48000]

## Upgrade Command
```bash
python -m pip install 'transformers==5.16.0'
```