# Hugging Face Transformers v4.20.0 — Release & Upgrade Intelligence
- **Product:** Hugging Face Transformers (https://huggingface.co)
- **Version:** v4.20.0
- **Released:** Jun 16, 2022
- **Impact Score:** 5/10
- **Breaking Changes:** Not verified
- **Canonical Analysis:** https://changelogs.us/transformers/updates/v4.20.0/

## Executive Summary (TL;DR)
Hugging Face Transformers v4.20.0. Source highlight: You can now use the big model inference of Accelerate directly in any call to `from_pretrained` by specifying `device_map="auto"` (or your own `device_map`). It will automatically load the model taking advantage of your GPU(s) then offloading what doesn't fit in RAM, or even on the hard drive if you

## New Features
- Add CvT  by @NielsRogge and @AnugunjNaman in #17299
- Add LayoutLMv3  by @NielsRogge in #17060
- Add `LongT5` model  by @stancld in #16792
- Add trajectory transformer  by @CarlCochet in #17141
- Add Wav2Vec2Conformer  by @patrickvonplaten in #16812
- Add TFData2VecVision for semantic segmentation  by @sayakpaul in #17271

## Bug Fixes
- Sort the model doc Toc Alphabetically  by @sgugger in #17723
- normalize keys_to_ignore  by @stas00 in #17722
- CLI: Add flag to push TF weights directly into main  by @gante in #17720
- Update requirements.txt  by @jeffra in #17719
- Revert "Change push CI to run on workflow_run event  by @ydshieh in #17692)"
- Documentation: RemBERT fixes  by @stefan-it in #17641

## Upgrade Command
```bash
python -m pip install 'transformers==4.20.0'
```