# Hugging Face Transformers v4.28.0 — Release & Upgrade Intelligence
- **Product:** Hugging Face Transformers (https://huggingface.co)
- **Version:** v4.28.0
- **Released:** Apr 13, 2023
- **Impact Score:** 7/10
- **Breaking Changes:** Source flagged
- **Canonical Analysis:** https://changelogs.us/transformers/updates/v4.28.0/

## Executive Summary (TL;DR)
Hugging Face Transformers v4.28.0. Source highlight: The LLaMA model was proposed in LLaMA: Open and Efficient Foundation Language Models. It is a collection of foundation language models ranging from 7B to 65B parameters. You can request access to the weights here then use the conversion script to generate a checkpoint compatible with Hugging Face

## Breaking Changes & Deprecations
- Breaking Changes ### Ordering of height and width for the BLIP image processor
- Adapt find_tied_parameters to handle breaking change in Accelerate  by @sgugger in #22360

## New Features
- Add Pix2Struct  by @younesbelkada in #21400
- Add DePlot + MatCha on `transformers`  by @younesbelkada in #22528
- Add Mega: Moving Average Equipped Gated Attention  by @mnaylor5 in #21766
- Add GPTBigCode model (Optimized GPT2 with MQA from Santacoder & BigCode)  by @jlamypoirier in #22575
- `NLLB-MoE` Adds the moe model  by @ArthurZucker in #22024
- Add TF port of BLIP  by @Rocketknight1 in #22090

## Bug Fixes
- 🚨🚨🚨   Fix ordering of height, width for BLIP image processor  by @amyeroberts in #22466
- 🚨🚨🚨 `[NLLB Tokenizer]` Fix the prefix tokens 🚨🚨🚨  by @ArthurZucker in #22313
- Load optimizer state on CPU to avoid CUDA OOM  by @sgugger in #22159
- Run all tests by default  by @sgugger in #22162
- Fix: unfinished_sequences with correct device   by @Stxr in #22184
- Revert 22152 MaskedImageCompletionOutput changes  by @amyeroberts in #22187

## Upgrade Command
```bash
python -m pip install 'transformers==4.28.0'
```