Home / AI / Hugging Face Transformers / v3.0.1
Hugging Face Transformers v3.0.1stable Released Jul 03, 2020
⚠️ Breaking Change Impact Score: 7/10

Hugging Face Transformers: Patch v3.0.1: Better backward compatibility for tokenizers

Source available — automated, not human-reviewed

Component: transformers · Channel: stable. Automated analysis, not a compatibility certification. How this works.

Analysis updated: 2026-11-01.

Breaking-change evidence from the source

  • This refactoring was conducted with a particular focus on keeping backward compatibility for the v2.X encoding, truncation and padding API but still led to two breaking changes that could have been avoided.
Read the original context ↗
Source flags breaking changes — review applicability
$ python -m pip install 'transformers==3.0.1'
📄 .MD
🔧 Bug Fixes 6 ⚠️ Breaking & Deprecations 1
⚡ Executive Summary (TL;DR)

Hugging Face Transformers v3.0.1. Source highlight: Better backward-compatibility for tokenizers following v3.0.0 refactoring

Visit Hugging Face Transformers Official Site ↗ Official Release Source ↗ All Hugging Face Transformers Releases 📡 Hugging Face Transformers RSS
Who Does This Impact? (Role-Based Analysis)

💻 Software Engineers & Devs

Check the source notes against the package and APIs you use before upgrading.

📊 Product & Engineering Leads

Use the documented changes to assess relevance to your product; release frequency alone is not a quality measure.

⚙️ DevOps & Security

Verify the target version, runtime requirements and rollback procedure in the official documentation.

⚠️ Breaking Changes & Deprecations (1)

  • This refactoring was conducted with a particular focus on keeping backward compatibility for the v2.X encoding, truncation and padding API but still led to two breaking changes that could have been avoided.

🔧 Bug Fixes & Patches (6)

  • Better support for TransfoXL tokenizer when using TextGenerationPipeline https://github.com/huggingface/transformers/pull/5465 (@TevenLeScao)
  • Fix use of meme Transformer-XL generations https://github.com/huggingface/transformers/pull/4826 (@tommccoy1)
  • Fixing a bug in the NER pipeline which lead to discarding the last identified entity https://github.com/huggingface/transformers/pull/5439 (@mfuntowicz and @enzoampil)
  • Better QAPipelines https://github.com/huggingface/transformers/pull/5429 (@mfuntowicz)
  • Add Question-Answering and MLM heads to the Reformer model https://github.com/huggingface/transformers/pull/5433 (@patrickvonplaten)
  • Refactoring the LongFormer https://github.com/huggingface/transformers/pull/5219 (@patrickvonplaten)
📄 View Raw Release Notes (Original Developer Log)
# Better backward-compatibility for tokenizers following v3.0.0 refactoring Version v3.0.0, included a refactoring of the tokenizers' backend to allow a simpler and more flexible [user-facing API](https://huggingface.co/transformers/preprocessing.html). This refactoring was conducted with a particular focus on keeping backward compatibility for the v2.X encoding, truncation and padding API but still led to two breaking changes that could have been avoided. This patch aims to bring back better backward compatibility, by implementing the following updates: - the `prepare_for_model` method is now publicly exposed again for both slow and fast tokenizers with an API compatible with both the v2.X truncation/padding API and [the v3.0 recommended API](https://huggingface.co/transformers/preprocessing.html). - the truncation strategy now defaults again to `longest_first` instead of `first_only`. # Bug fixes and improvements: - Better support for TransfoXL tokenizer when using TextGenerationPipeline https://github.com/huggingface/transformers/pull/5465 (@TevenLeScao) - Fix use of meme Transformer-XL generations https://github.com/huggingface/transformers/pull/4826 (@tommccoy1) - Fixing a bug in the NER pipeline which lead to discarding the last identified entity https://github.com/huggingface/transformers/pull/5439 (@mfuntowicz and @enzoampil) - Better QAPipelines https://github.com/huggingface/transformers/pull/5429 (@mfuntowicz) - Add Question-Answering and MLM heads to the Reformer model https://github.com/huggingface/transformers/pull/5433 (@patrickvonplaten) - Refactoring the LongFormer https://github.com/huggingface/transformers/pull/5219 (@patrickvonplaten) - Various fixes on tokenizers and tests (@sshleifer) - Many improvements to the doc and tutorials (@sgugger) - Fix TensorFlow dataset generator in run_glue https://github.com/huggingface/transformers/pull/4881 (@jplu) - Update Bertabs example to work again https://github.com/huggingface/transformers/pull/5355 (@MichaelJanz) - Move GenerationMixin to separate file https://github.com/huggingface/transformers/pull/5254 (@yjernite)
← Older Version Hugging Face Transformers v3.0.0