Skip to content

transformers v5.5#1684

Draft
echarlaix wants to merge 38 commits intomainfrom
transformers-v5.5
Draft

transformers v5.5#1684
echarlaix wants to merge 38 commits intomainfrom
transformers-v5.5

Conversation

@echarlaix
Copy link
Copy Markdown
Collaborator

No description provided.

@HuggingFaceDocBuilderDev
Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

SUPPORTED_ARCHITECTURES += ("data2vec-text", "flaubert", "xlm")

if is_transformers_version("!=", "4.52"):
SUPPORTED_ARCHITECTURES += ("convbert",)
Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@echarlaix echarlaix added the openvino-slow Runs OpenVINO slow tests with different versions of transformers label Apr 17, 2026
@echarlaix echarlaix removed the openvino-slow Runs OpenVINO slow tests with different versions of transformers label Apr 20, 2026
@echarlaix echarlaix added the openvino-slow Runs OpenVINO slow tests with different versions of transformers label Apr 24, 2026
@echarlaix echarlaix removed the openvino-slow Runs OpenVINO slow tests with different versions of transformers label Apr 27, 2026
Comment thread setup.py
"optimum-onnx@git+https://github.com/huggingface/optimum-onnx.git@transformers-v5",
"transformers>=4.45,<5.1",
"optimum-onnx@git+https://github.com/huggingface/optimum-onnx.git@xadupre/transformers5",
"transformers>=4.57,<5.5",
Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

setting min transformers version to v4.57, will replicate everywhere once validated cc @rkazants

@echarlaix echarlaix added the openvino-slow Runs OpenVINO slow tests with different versions of transformers label Apr 28, 2026
@echarlaix echarlaix removed the openvino-slow Runs OpenVINO slow tests with different versions of transformers label Apr 28, 2026
Comment thread setup.py
"torch>=2.1",
"optimum-onnx@git+https://github.com/huggingface/optimum-onnx.git@transformers-v5",
"transformers>=4.45,<5.1",
"optimum-onnx@git+https://github.com/huggingface/optimum-onnx.git@transformers-v5.5",
Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
"optimum-onnx@git+https://github.com/huggingface/optimum-onnx.git@transformers-v5.5",
"optimum@git+https://github.com/huggingface/optimum",

should be updated before merging (once #1690 merged and huggingface/optimum#2430 for v5.4)


# Add the attention_mask inputs when needed
if "attention_mask" in self.input_names:
if attention_mask is None:
Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

before v5.2 attention_mask was created in generate by calling _prepare_attention_mask_for_generation https://github.com/huggingface/transformers/blob/v5.1.0/src/transformers/generation/utils.py#L2530 not the case of encoder_decoder model since v5.2 https://github.com/huggingface/transformers/blob/v5.2.0/src/transformers/generation/utils.py#L2555

SUPPORTED_ARCHITECTURES += ("llava_next_video",)
else:
UNSUPPORTED_ARCHITECTURES.update({"got_ocr2", "idefics3", "llama4", "llava_next_video", "smolvlm"})
_is_model_supported = {
Copy link
Copy Markdown
Collaborator Author

@echarlaix echarlaix Apr 29, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TODO: extend for all architectures (waiting for validation min required transformers version set to 4.57 / can be done in a following PR if needed)

# known issues with marian on OpenVINO 2025.3.x and 2025.4.x
# TODO: add fix for v5 and update MAX_TRANSFORMERS_VERSION accordingly (mt5)
_is_model_supported = {
"m2m_100": is_transformers_version("!=", "5.4"),
Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants