# Hugging Face Transformers v4.39.0 — Release & Upgrade Intelligence
- **Product:** Hugging Face Transformers (https://huggingface.co)
- **Version:** v4.39.0
- **Released:** Mar 21, 2024
- **Impact Score:** 7/10
- **Breaking Changes:** Source flagged
- **Canonical Analysis:** https://changelogs.us/transformers/updates/v4.39.0/

## Executive Summary (TL;DR)
Hugging Face Transformers v4.39.0. Source highlight: 🚨 VRAM consumption 🚨

## Breaking Changes & Deprecations
- Breaking changes The PRs below introduced slightly breaking changes that we believed was necessary for the repository; if these seem to impact your usage of transformers, we recommend checking out the PR description to get more insights in how to leverage the new behavior.
- The PRs below introduced slightly breaking changes that we believed was necessary for the repository; if these seem to impact your usage of transformers, we recommend checking out the PR description to get more insights in how to leverage the new behavior.

## New Features
- Add MusicGen Melody  by @ylacombe in #28819
- Add PvT-v2 Model  by @FoamoftheSea in #26812
- Add UDOP  by @NielsRogge in #22940
- [`Add Mamba`] Adds support for the `Mamba` models  by @ArthurZucker in #28094
- Add mlx support to BatchEncoding.convert_to_tensors  by @Y4hL in #29406
- Add support for metadata format MLX  by @alexweberk in #29335

## Improvements
- Better visual reasoning and OCR capability with an improved visual instruction tuning data mixture.
- Along with performance improvements, LLaVA-NeXT maintains the minimalist design and data efficiency of LLaVA-1.5. It re-uses the pretrained connector of LLaVA-1.5, and still uses less than 1M visual instruction tuning samples. The largest 34B variant finishes training in ~1 day with 32 A100s.*
- Use `torch.bool` instead of `torch.int64` for non-persistant causal mask buffer  by @fxmarty in #29241
- Allow remote code repo names to contain "."  by @Rocketknight1 in #29175

## Bug Fixes
- simplify get_class_in_module and fix for paths containing a dot  by @cebtenzzre in #29262
- FIX [`Gemma`] Fix bad rebase with transformers main  by @younesbelkada in #29170
- Add training version check for AQLM quantizer.  by @BlackSamorez in #29142
- [Gemma] Fix eager attention  by @sanchit-gandhi in #29187
- [Mistral, Mixtral] Improve docs  by @NielsRogge in #29084
- Fix `torch.compile` with `fullgraph=True` when `attention_mask` input is used  by @fxmarty in #29211

## Upgrade Command
```bash
python -m pip install 'transformers==4.39.0'
```