# Hugging Face Transformers 1.2.0 — Release & Upgrade Intelligence
- **Product:** Hugging Face Transformers (https://huggingface.co)
- **Version:** 1.2.0
- **Released:** Sep 04, 2019
- **Impact Score:** 5/10
- **Breaking Changes:** Not verified
- **Canonical Analysis:** https://changelogs.us/transformers/updates/1.2.0/

## Executive Summary (TL;DR)
Hugging Face Transformers 1.2.0. Source highlight: New model architecture: DistilBERT

## Bug Fixes
- Bertology script has seen major improvements (@tuvuumass )
- Iterative tokenization now faster and accept arbitrary numbers of added tokens (@samvelyan)
- Added RoBERTa to AutoModels and AutoTokenizers (@LysandreJik )
- Added GPT-2 Large 774M model (@thomwolf )
- Added language model fine-tuning with GPT/GPT-2 (CLM), BERT/RoBERTa (MLM) (@LysandreJik @thomwolf )
- Multi-GPU training has been patched (@FeiWang96 )

## Upgrade Command
```bash
python -m pip install 'transformers==1.2.0'
```