Skip to content

Amazon Bedrock Generators: Update model list #1673

@bilgeyucel

Description

@bilgeyucel

Is your feature request related to a problem? Please describe.
amazon.nova-*, deepseek.r1-v1:0, ai21.jamba-1-5-* models are not supported by AmazonBedrockGenerator and raise this error:

Could not auto-detect model family of amazon.nova-lite-v1:0. model_family parameter must be one of ('amazon.titan-text', 'ai21.j2', 'cohere.command', 'cohere.command-r', 'anthropic.claude', 'meta.llama', 'mistral').

The Could not auto-detect model family error doesn't show up with AmazonBedrockChatGenerator. Bypassing this error seems like a bug for AmazonBedrockChatGenerator, as this might mean that we don't check the model family (maybe it's not required, idk)

Describe the solution you'd like

  • Add missing model prefixes to the model_family and remove the old ai21.j2.
  • Add model family check to AmazonBedrockChatGenerator for consistency

Describe alternatives you've considered
N/A

Additional context
Notebook to test model supports https://colab.research.google.com/drive/1t2TYbc75uP4LJbcqKXX2KHR98hW4TuLf?usp=sharing

Once these models are added to the integration, we should update the integration page content here and the related documentation pages, especially the parts about "Supported models".

Metadata

Metadata

Assignees

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions