Skip to content

decoder_input_ids/decoder_inputs_embeds missing in example inputs for hf_T5_base #2670

@josefmalmstrom

Description

@josefmalmstrom

Trying to run torchbenchmark/models/hf_T5_base in eager mode with the provided example inputs yields this error:

RuntimeError: Execution of compiled model failed: You have to specify either decoder_input_ids or decoder_inputs_embeds

Edit1: From what I understand, this could be fixed by having whatever generated the inputs include decoder_input_ids as an identical copy of input_ids.

Edit2: Looks like this is the code that generates the inputs? https://github.com/pytorch/benchmark/blob/main/torchbenchmark/util/framework/huggingface/basic_configs.py#L281

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions