v4.21.0 is a minor release. Key changes include:

• Generate: deprecate default max_length by @gante in #18018;
• TF: GPT-J compatible with XLA generation by @gante in #17986.

v4.20.1 is a patch release. Key changes include:

• Add final_layer_norm to OPT model #17785;
• Prepare transformers for v0.8.0 huggingface-hub release #17716.

v4.20.0 is a minor release. Key changes include:

• Use Accelerate in from_pretrained for big model inference by @sgugger in #17341;
• BLOOM by @younesbelkada in #17474.

v4.19.4 is a patch release. Key changes include:

• Fixes the errors message when trying to access a repo that does not exist (started to break due to changes in Hub API).;
• [🐛]Properly raise RepoNotFoundError when not authenticated #17651[.

v4.19.3 is a patch release: pin protobouf that breaks tensorboard in pytorch #17440

v4.19.2 is a patch release. Key changes include:

• OPT-fix #17229;
• OPT - fix docstring and improve tests slighly #17228.

v4.19.1 is a patch release. Key changes include:

• v4.19.1 Patch release;
• Fix Trainer for Datasets that don't have dict items #17239.

v4.19.0 is a minor release. Key changes include:

• Add OPT by @younesbelkada in #17088;
• [feat] Add FLAVA model by @apsdehal in #16654.

v4.18.0 is a minor release. Key changes include:

• Add GLPN by @NielsRogge in https://github.com/huggingface/transformers/pull/16199;
• Resnet by @FrancescoSaverioZuppichini in https://github.com/huggingface/transformers/pull/15770.

v4.17.0 is a minor release. Key changes include:

• Add XGLM models by @patil-suraj in https://github.com/huggingface/transformers/pull/14876;
• Add ConvNeXT by @NielsRogge in https://github.com/huggingface/transformers/pull/15277.

v4.16.2 is a patch release. Key changes include:

• Add header (huggingface#15434);
• [Hotfix] Fix Swin model outputs (huggingface#15414).

v4.16.1 is a patch release. Key changes include:

• V4.16.1: Patch Release;
• Add init to BORT (#15378) by @LysandreJik.

v4.16.0 is a minor release. Key changes include:

• Add Nystromformer by @novice03 in https://github.com/huggingface/transformers/pull/14659;
• Add REALM by @qqaatw in https://github.com/huggingface/transformers/pull/13292.

v4.21.0 is a minor release. Key changes include:

• Generate: deprecate default max_length by @gante in #18018;
• TF: GPT-J compatible with XLA generation by @gante in #17986.

v4.20.1 is a patch release. Key changes include:

• Add final_layer_norm to OPT model #17785;
• Prepare transformers for v0.8.0 huggingface-hub release #17716.

v4.20.0 is a minor release. Key changes include:

• Use Accelerate in from_pretrained for big model inference by @sgugger in #17341;
• BLOOM by @younesbelkada in #17474.

v4.19.4 is a patch release. Key changes include:

• Fixes the errors message when trying to access a repo that does not exist (started to break due to changes in Hub API).;
• [🐛]Properly raise RepoNotFoundError when not authenticated #17651[.

v4.19.3 is a patch release: pin protobouf that breaks tensorboard in pytorch #17440

v4.19.2 is a patch release. Key changes include:

• OPT-fix #17229;
• OPT - fix docstring and improve tests slighly #17228.

v4.19.1 is a patch release. Key changes include:

• v4.19.1 Patch release;
• Fix Trainer for Datasets that don't have dict items #17239.

v4.19.0 is a minor release. Key changes include:

• Add OPT by @younesbelkada in #17088;
• [feat] Add FLAVA model by @apsdehal in #16654.

v4.18.0 is a minor release. Key changes include:

• Add GLPN by @NielsRogge in https://github.com/huggingface/transformers/pull/16199;
• Resnet by @FrancescoSaverioZuppichini in https://github.com/huggingface/transformers/pull/15770.

v4.17.0 is a minor release. Key changes include:

• Add XGLM models by @patil-suraj in https://github.com/huggingface/transformers/pull/14876;
• Add ConvNeXT by @NielsRogge in https://github.com/huggingface/transformers/pull/15277.

v4.16.2 is a patch release. Key changes include:

• Add header (huggingface#15434);
• [Hotfix] Fix Swin model outputs (huggingface#15414).

v4.16.1 is a patch release. Key changes include:

• V4.16.1: Patch Release;
• Add init to BORT (#15378) by @LysandreJik.

v4.16.0 is a minor release. Key changes include:

• Add Nystromformer by @novice03 in https://github.com/huggingface/transformers/pull/14659;
• Add REALM by @qqaatw in https://github.com/huggingface/transformers/pull/13292.