Skip to content

Filter for selecting Trainium Instances #350

@GyandeepKalita

Description

@GyandeepKalita

Hi,

There seems to be no filter in the ec2-instance-selector to select the AWS Trainium Instances. It would be of great help if a filter for this can be included. Maybe some filter for NeuronInfo as in the describe instance types, similar to --inference-accelerator would be fine:

$ aws ec2 describe-instance-types --instance-type="trn1.32xlarge"
      ...
      "NeuronInfo": {
               "NeuronDevices": [
                   {
                       "Count": 16,
                       "Name": "Trainium",
                       "CoreInfo": {
                           "Count": 2,
                           "Version": 2
                       },
                       "MemoryInfo": {
                           "SizeInMiB": 32768
                       }
                   }
               ],
               "TotalNeuronDeviceMemoryInMiB": 524288
           },

Thanks in advance.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions