Skip to content

[Bug Report] p2.xlarge is not supported for "BERT Base Cased" model deployment! #4833

Description

@sevmax7

Link to the notebook
Introduction to SageMaker HuggingFace - Text Classification.

Describe the bug
In "4.6. Deploy & run Inference on the fine-tuned model" section, the instance type is set to "ml.p2.xlarge"; however, it's not supported for the "BERT Base Cased" model. Here is the error message when creating the endpoint with p2.xlarge instance:

Invalid combination: instance p2 and Cuda 12.2. Please provide a supported configuration for this region.

To reproduce
Running the notebook with default settings will replicate the error.

Logs
N/A

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions