Release candidate v5.0.0rc3

New models:

• [GLM-4.7] GLM-Lite Supoort by @zRzRzRzRzRzRzR in https://github.com/huggingface/transformers/pull/43031
• [GLM-Image] AR Model Support for GLM-Image by @zRzRzRzRzRzRzR in https://github.com/huggingface/transformers/pull/43100
• Add LWDetr model by @sbucaille in https://github.com/huggingface/transformers/pull/40991
• Add LightOnOCR model implementation by @baptiste-aubertin in https://github.com/huggingface/transformers/pull/41621

What's Changed

We are getting closer and closer to the official release! This RC is focused on removing more of the deprecated stuff, fixing some minors issues, doc updates.

• Update Japanese README to match English version by @lilin-1 in https://github.com/huggingface/transformers/pull/43069
• [docs] Deploying by @stevhliu in https://github.com/huggingface/transformers/pull/42263
• [docs] inference engines by @stevhliu in https://github.com/huggingface/transformers/pull/42932
• Fix typos: Remove duplicate duplicate words words by @efeecllk in https://github.com/huggingface/transformers/pull/43040
• [style] Rework ruff rules and update all files by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43144
• [CB] Minor fix in kwargs by @remi-or in https://github.com/huggingface/transformers/pull/43147
• [Bug] qwen2_5_omni: cap generation length to be less than the max_position_embedding in DiT by @sniper35 in https://github.com/huggingface/transformers/pull/43068
• Fix some deprecated practices in torch 2.9 by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43167
• Fix Fuyu processor width dimension bug in _get_num_multimodal_tokens by @Abhinavexists in https://github.com/huggingface/transformers/pull/43137
• Inherit from PreTrainedTokenizerBase by @juliendenize in https://github.com/huggingface/transformers/pull/43143
• Generation config boolean defaults by @zucchini-nlp in https://github.com/huggingface/transformers/pull/43000
• Fix failing BartModelIntegrationTest by @Sai-Suraj-27 in https://github.com/huggingface/transformers/pull/43160
• fix failure of llava/pixtral by @sywangyi in https://github.com/huggingface/transformers/pull/42985
• GemmaTokenizer: remove redundant whitespace pre-tokenizer by @vaibhav-research in https://github.com/huggingface/transformers/pull/43106
• Support auto_doctring in Processors by @yonigozlan in https://github.com/huggingface/transformers/pull/42101
• Fix failing BitModelIntegrationTest by @Sai-Suraj-27 in https://github.com/huggingface/transformers/pull/43164
• [Fp8] Fix experts by @vasqu in https://github.com/huggingface/transformers/pull/43154
• Docs: improve wording for documentation build instructions by @Sailnagale in https://github.com/huggingface/transformers/pull/43007
• [makefile] Cleanup and improve the rules by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43171
• Some new models added stuff that was already removed by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43179
• Fixes and compilation warning in torchao docs by @merveenoyan in https://github.com/huggingface/transformers/pull/42909
• [cache] Remove all deprecated classes by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43168
• Bump huggingface_hub minimal version by @Wauplin in https://github.com/huggingface/transformers/pull/43188
• Rework check_config_attributes.py by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43191
• Fix generation config validation by @zucchini-nlp in https://github.com/huggingface/transformers/pull/43175
• [style] Use 'x | y' syntax for processors as well by @Wauplin in https://github.com/huggingface/transformers/pull/43189
• Remove deprecated objects by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43170
• fix chunked prefill implementation issue-43082 by @marcndo in https://github.com/huggingface/transformers/pull/43132
• Reduce add_dates verbosity by @yonigozlan in https://github.com/huggingface/transformers/pull/43184
• Add support for MiniMax-M2 by @rogeryoungh in https://github.com/huggingface/transformers/pull/42028
• Fix failing salesforce-ctrl, xlm & gpt-neo model generation tests by @Sai-Suraj-27 in https://github.com/huggingface/transformers/pull/43180
• Less verbose library helpers by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43197
• run all test files on CircleCI by @ydshieh in https://github.com/huggingface/transformers/pull/43146
• Clamp temperature to >=1.0 for Dia generation by @Haseebasif7 in https://github.com/huggingface/transformers/pull/43029
• Fix spelling typos in comments and code by @raimbekovm in https://github.com/huggingface/transformers/pull/43046
• [docs] llama.cpp by @stevhliu in https://github.com/huggingface/transformers/pull/43185
• [docs] gptq formatting fix by @victorywwong in https://github.com/huggingface/transformers/pull/43216
• Grouped beam search from config params by @zucchini-nlp in https://github.com/huggingface/transformers/pull/42472
• [Generate] Allow custom config values in generate config by @vasqu in https://github.com/huggingface/transformers/pull/43181
• Fix failing Pix2StructIntegrationTest by @Sai-Suraj-27 in https://github.com/huggingface/transformers/pull/43229
• Fix missing UTF-8 encoding in check_repo.py for Windows compatibility by @aarushisingh04 in https://github.com/huggingface/transformers/pull/43123
• [Tokenizer] Change default value of return_dict to True in doc string for apply_chat_template by @kashif in https://github.com/huggingface/transformers/pull/43223
• Fix failing PhiIntegrationTests by @Sai-Suraj-27 in https://github.com/huggingface/transformers/pull/43214
• Use HF_TOKEN directly and remove require_read_token by @ydshieh in https://github.com/huggingface/transformers/pull/43233
• Fix failing Owlv2ModelIntegrationTest & OwlViTModelIntegrationTest by @Sai-Suraj-27 in https://github.com/huggingface/transformers/pull/43182
• Fix flashattn wrt quantized models by @SunMarc in https://github.com/huggingface/transformers/pull/43145
• Remove unused imports by @cyyever in https://github.com/huggingface/transformers/pull/43078
• Fix unsafe torch.load() in _load_rng_state allowing arbitrary code execution by @ColeMurray in https://github.com/huggingface/transformers/pull/43140
• Reapply modular to examples by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43234
• More robust diff checks in add_dates by @yonigozlan in https://github.com/huggingface/transformers/pull/43199
• docs: fix grammatical error in README.md by @davidfertube in https://github.com/huggingface/transformers/pull/43236
• Fix typo: seperately → separately in lw_detr converter by @skyvanguard in https://github.com/huggingface/transformers/pull/43235
• Qwen-VL video processor accepts min/max pixels by @zucchini-nlp in https://github.com/huggingface/transformers/pull/43228
• Deprecate dtype per sub config by @zucchini-nlp in https://github.com/huggingface/transformers/pull/42990
• Remove more deprecated objects/args by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43195
• [CB] Soft-reset offloading by @remi-or in https://github.com/huggingface/transformers/pull/43150
• Make benchmark-v2 to be device agnostic, to support more torch built-in devices like xpu by @yao-matrix in https://github.com/huggingface/transformers/pull/43153
• Fix benchmark script by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43253
• Adding to run slow by @IlyasMoutawwakil in https://github.com/huggingface/transformers/pull/43250
• Fix failing Vip-llava model integration test by @Sai-Suraj-27 in https://github.com/huggingface/transformers/pull/43252
• Remove deprecated and unused position_ids in all apply_rotary_pos_emb by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43255
• fix _get_test_info in testing_utils.py by @ydshieh in https://github.com/huggingface/transformers/pull/43259
• Fix failing Hiera, SwiftFormer & LED Model integration tests by @Sai-Suraj-27 in https://github.com/huggingface/transformers/pull/43225
• [style] Fix init isort and align makefile and CI by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43260
• [docs] tensorrt-llm by @stevhliu in https://github.com/huggingface/transformers/pull/43176
• [consistency] Ensure models are added to the _toctree.yml by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43264
• Fix failing PegasusX, Mvp & LED model integration tests by @Sai-Suraj-27 in https://github.com/huggingface/transformers/pull/43245
• [CB] Ensure parallel decoding test passes using FA by @remi-or in https://github.com/huggingface/transformers/pull/43277
• fix crash in when running FSDP2+TP by @sywangyi in https://github.com/huggingface/transformers/pull/43226
• [ci] Fixing some failing tests for important models by @Abdennacer-Badaoui in https://github.com/huggingface/transformers/pull/43231

New Contributors

• @efeecllk made their first contribution in https://github.com/huggingface/transformers/pull/43040
• @sniper35 made their first contribution in https://github.com/huggingface/transformers/pull/43068
• @Abhinavexists made their first contribution in https://github.com/huggingface/transformers/pull/43137
• @vaibhav-research made their first contribution in https://github.com/huggingface/transformers/pull/43106
• @Sailnagale made their first contribution in https://github.com/huggingface/transformers/pull/43007
• @rogeryoungh made their first contribution in https://github.com/huggingface/transformers/pull/42028
• @Haseebasif7 made their first contribution in https://github.com/huggingface/transformers/pull/43029
• @victorywwong made their first contribution in https://github.com/huggingface/transformers/pull/43216
• @aarushisingh04 made their first contribution in https://github.com/huggingface/transformers/pull/43123
• @ColeMurray made their first contribution in https://github.com/huggingface/transformers/pull/43140
• @davidfertube made their first contribution in https://github.com/huggingface/transformers/pull/43236
• @skyvanguard made their first contribution in https://github.com/huggingface/transformers/pull/43235
• @baptiste-aubertin made their first contribution in https://github.com/huggingface/transformers/pull/41621

Full Changelog: https://github.com/huggingface/transformers/compare/v5.0.0rc2...v5.0.0rc3