Skip to content

Commit 7d926b8

Browse files
linaaafliamsommer-mxdbreseman
authored
Genai main additions (#11325)
* Update agent-commons.md Small troubleshooting addition about Oracle datatypes * Clarify GenAI Commons description in documentation Updated the description for GenAI Commons to clarify its role as a base module and required dependency. * Update model listings for OpenAI and image generation Updated OpenAI supported models * Revise model table and add API references Bedrock: Updated model listings and added links for Converse and InvokeModel APIs. * Update Converse API output capabilities Added 'Function calling' to the output capabilities for models supporting the Converse API. * Update image generation row in model capabilities table * Remove titan embed references * updated model support for bedrock embeddings * Update model support information in documentation For Bedrock * Revise model listings and add reference links Updated model names and added links for OpenAI and Mistral models and Google Gemini. * Update Gemini model listings in documentation * Reorder Mistral models in the documentation table * Fix formatting and update Mistral models list * Language edit * Apply feedback --------- Co-authored-by: Liam Sommer <161324156+liamsommer-mx@users.noreply.github.com> Co-authored-by: Dana Breseman <dana.breseman@mendix.com>
1 parent c460f03 commit 7d926b8

2 files changed

Lines changed: 27 additions & 44 deletions

File tree

content/en/docs/genai/_index.md

Lines changed: 21 additions & 27 deletions
Original file line numberDiff line numberDiff line change
@@ -62,7 +62,7 @@ Integrate AI capabilities into your applications with Agents Kit, a collection o
6262
| [Agent Commons](/agents/genai-for-mx/agent-commons/) | Build agentic functionality by defining, testing, and evaluating agents at runtime. Iterate on prompts and agent configurations without app redeployment through the integrated Agent Builder UI. | 10.24 |
6363
| [Agent Editor](/agents/genai-for-mx/agent-editor/) | Define agents as version-controlled documents in Studio Pro at design time. Author prompts, configure tools and knowledge bases, test locally, and deploy agents as part of your app model. | 11.9 |
6464
| [Conversational UI](/agents/genai-for-mx/conversational-ui/) | Create chat interfaces for full-screen, sidebar, or modal GenAI conversations. Monitor token consumption and trace interactions with UI features built on GenAI Commons. | 10.24 |
65-
| [GenAI Commons](/agents/genai-for-mx/commons/) | Use common capabilities that allow all GenAI connectors to be integrated with the other modules. You can also implement your own connector based on this module. | 10.24 |
65+
| [GenAI Commons](/agents/genai-for-mx/commons/) | Integrate GenAI connectors with other modules using common capabilities provided by this base module. Required dependency for both core and connector modules. You can also implement your own connector based on this module. | 10.24 |
6666

6767
#### Connector Modules {#connectors}
6868

@@ -103,49 +103,43 @@ Mendix [connectors](#connectors) offer direct support for the following models.
103103

104104
| Models | Category | Input | Output | Additional Capabilities |
105105
| --- | --- | --- | --- | --- |
106-
| gpt-4, gpt-4-turbo, gpt-4o, gpt-4o mini, gpt-4.1, gpt-4.1-mini, gpt-4.1-nano, gpt-5.0, gpt-5.0-mini, gpt-5.0-nano, gpt-5.1, gpt-5.2, o1, o1-mini, o3, o3-mini, o4-mini | Chat completions | text, image, document (OpenAI only) | text | Function calling |
107-
| DALL·E 2, DALL·E 3, gpt-image-1 | Image generation | text | image | |
106+
| gpt and o family, such as gpt-5.5 and o4 | Chat completions | text, image, document (OpenAI only) | text | Function calling |
107+
| gpt-image-1, gpt-image-1.5, gpt-image-2 | Image generation | text | image | |
108108
| text-embedding-ada-002, text-embedding-3-small, text-embedding-3-large | Embeddings | text | embeddings | |
109109

110+
For a list of all OpenAI models, see [Models](https://developers.openai.com/api/docs/models) in the OpenAI documentation.
111+
110112
#### Mistral
111113

112114
| Models | Category | Input | Output | Additional Capabilities |
113115
| --- | --- | --- | --- | --- |
114-
| Mistral Large 3, Mistral Medium 3.1, Mistral Small 3.2, Ministral 3 (3B, 8B, 14B), Magistral (Small, Medium) | Chat completions | text, image | text | Function calling |
115-
| Codestral, Devstral (Small, Medium), Open Mistral 7B, Mistral Nemo 12B | Chat completions | text | text | Function calling |
116+
| Mistral's generalist models such as Mistral Small 4, Mistral Medium 3.5, Mistral Large 3, and Ministral 3 (3B, 8B, 14B) | Chat completions | text, image | text | Function calling |
117+
| Codestral, Devstral | Chat completions | text | text | Function calling |
118+
| (Open) Mistral Nemo 12B | Chat completions | text | text | |
116119
| Mistral Embed, Codestral Embed | Embeddings | text | embeddings | |
117120

121+
For a list of all Mistral models, see [Models Overview](https://docs.mistral.ai/models/overview) in the Mistral documentation.
122+
118123
#### Google Gemini
119124

120125
| Models | Category | Input | Output | Additional Capabilities |
121126
| --- | --- | --- | --- | --- |
122-
| Gemini 2.5 Flash (+ Preview Sep 2025), Gemini 2.5 Flash-Lite (+ Preview Sep 2025), Gemini 2.5 Pro, Gemini Flash Latest, Gemini Flash-Lite Latest, Gemini Pro Latest | Chat completions | text, image | text | Function calling |
123-
| Gemini 3 Flash Preview, Gemini 3 Pro Preview | Chat completions | text, image | text | |
127+
| Gemini 2.5 Flash, Gemini 2.5 Flash-Lite, Gemini 2.5 Pro, Gemini Flash Latest, Gemini Flash-Lite Latest, Gemini Pro Latest | Chat completions | text, image | text | Function calling |
128+
| Gemini 3 Flash Preview, Gemini 3.1 Flash-Lite, Gemini 3.1 Pro Preview, Gemini 3.5 Flash | Chat completions | text, image | text | |
124129

125130
#### Amazon Bedrock
126131

127132
| Models | Category | Input | Output | Additional Capabilities |
128133
| --- | --- | --- | --- | --- |
129-
| Amazon Titan Text G1 - Express, Amazon Titan Text G1 - Lite, Amazon Titan Text G1 - Premier | Chat completions | text, document (except Titan Premier) | text | |
130-
| AI21 Jamba-Instruct | Chat completions | text | text | |
131-
| AI21 Labs Jurassic-2 (Text) | Chat completions | text | text | |
132-
| Amazon Nova Pro, Amazon Nova Lite | Chat completions | text, image, document | text | Function calling |
133-
| Amazon Titan Image Generator G1 | Image generation | text | image | |
134-
| Amazon Titan Embeddings Text v2 | Embeddings | text | embeddings | |
135-
| Anthropic Claude 3 Sonnet, Anthropic Claude 3.5 Sonnet, Anthropic Claude 3.5 Sonnet v2, Anthropic Claude 3 Haiku, Anthropic Claude 3 Opus, Anthropic Claude 3.5 Haiku, Anthropic Claude 4.5 Sonnet, Anthropic Claude 4.5 Haiku, Anthropic Claude 4.5 Opus | Chat completions | text, image, document | text | Function calling |
136-
| Cohere Command | Chat completions | text, document | text | |
137-
| Cohere Command Light | Chat completions | text | text | |
138-
| Cohere Command R, Cohere Command R+ | Chat completions | text, document | text | Function calling |
139-
| Cohere Embed English, Cohere Embed Multilingual | Embeddings | text | embeddings | |
140-
| DeepSeek, DeepSeek-R1 | Text | text | document | |
141-
| Meta Llama 2, MetaLlama 3 | Chat completions | text, document | text | |
142-
| Meta Llama 3.1 | Chat completions | text, document | text | Function calling |
143-
| Mistral AI Instruct | Chat completions | text, document | text | |
144-
| Mistral Large, Mistral Large 2 | Chat completions | text, document | text | Function calling |
145-
| Mistral Small | Chat completions | text | text | Function calling |
146-
| OpenAI gpt-oss-20B, gpt-oss-120b | Chat completions | text | text | |
147-
148-
For more details on limitations and supported model capabilities for the Bedrock Converse API used in the ChatCompletions operations, see [Supported models and model features](https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference-supported-models-features.html) in the AWS documentation.
134+
| Native support for models that support the Converse API, with providers including Anthropic Claude, DeepSeek, Meta, and OpenAI (OSS models). | Chat completions | text, document, image | text | Function calling |
135+
| Native support for [models by Cohere](https://docs.aws.amazon.com/bedrock/latest/userguide/model-cards-cohere.html), and configurable support for all other models that support the Invoke API. | Embeddings | text | embeddings | |
136+
| Native support for Titan Image Generator G1 v2 (availability varies by region), and configurable support for all other models that support the Invoke API. | Image generation | text | image | |
137+
138+
{{% alert color="info" %}}
139+
For embeddings and image generation, models that support the Invoke API but lack native support can be supported after minor configuration changes.
140+
{{% /alert %}}
141+
142+
For a list of all Bedrock Models, see [Models at a glance](https://docs.aws.amazon.com/bedrock/latest/userguide/model-cards.html). To determine if a model supports the Converse or Invoke APIs, see the model details after selecting a model from the list.
149143

150144
#### Connecting to Other Models
151145

content/en/docs/marketplace/platform-supported-content/modules/aws/amazon-bedrock.md

Lines changed: 6 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -232,7 +232,6 @@ To invoke a Bedrock agent for your Mendix app, do the following steps:
232232
* Chat Completions with History
233233
* Chat Completion without History
234234
* Embeddings with Cohere Embed
235-
* Embeddings with Amazon Titan Embeddings
236235

237236
For more information about using this feature, refer to the [GenAI commons documentation](/agents/genai-for-mx/commons/#token-usage).
238237

@@ -337,19 +336,19 @@ For Titan Image models, the `Image Generation: Add Titan Image Extension` operat
337336

338337
#### Generate Embeddings (String) {#embeddings-single-string}
339338

340-
The [Generate Embeddings (String)](/agents/genai-for-mx/commons/#embeddings-string) activity can be used to generate an embedding vector for a given input string with one of the Cohere Embed models or Titan Embeddings v2.
339+
The [Generate Embeddings (String)](/agents/genai-for-mx/commons/#embeddings-string) activity can be used to generate an embedding vector for a given input string with one of the Cohere Embed models.
341340

342-
For Cohere Embed and Titan Embeddings, the request can be associated to their respective EmbeddingsOptions extension object which can be created with the [Embeddings Options: Add Cohere Embed Extension](#add-cohere-embed-extension) or [Embeddings Options: Add Titan Embeddings Extension](#add-titan-embeddings-extension) operation. Through this extension, it is possible to tailor the operation to more specific needs.
341+
For Cohere Embed, the request can be associated to their respective EmbeddingsOptions extension object which can be created with the [Embeddings Options: Add Cohere Embed Extension](#add-cohere-embed-extension) operation. Through this extension, it is possible to tailor the operation to more specific needs.
343342

344-
Currently, embeddings are available for the Cohere Embed family and or Titan Embeddings v2.
343+
Currently, embeddings are available for the Cohere Embed family.
345344

346345
#### Generate Embeddings (Chunk Collection) {#embeddings-chunk-collection}
347346

348-
The [Generate Embeddings (Chunk Collection)](/agents/genai-for-mx/commons/#embeddings-chunk-collection) activity can be used to generate a collection of embedding vectors for a given collection of text chunks with one of the Cohere Embed models or Titan Embeddings v2.
347+
The [Generate Embeddings (Chunk Collection)](/agents/genai-for-mx/commons/#embeddings-chunk-collection) activity can be used to generate a collection of embedding vectors for a given collection of text chunks with one of the Cohere Embed models.
349348

350-
For each model family, the request can be associated to an extension of the EmbeddingsOptions object which can be created with either the [Embeddings Options: Add Cohere Embed Extension](#add-cohere-embed-extension) or the [Embeddings Options: Add Titan Embeddings Extension](#add-titan-embeddings-extension) operation. Through this extension, it is possible to tailor the operation to more specific needs.
349+
For each model family, the request can be associated to an extension of the EmbeddingsOptions object which can be created with either the [Embeddings Options: Add Cohere Embed Extension](#add-cohere-embed-extension) operation. Through this extension, it is possible to tailor the operation to more specific needs.
351350

352-
Currently, embeddings are available for the Cohere Embed family and Titan Embeddings v2.
351+
Currently, embeddings are available for the Cohere Embed family.
353352

354353
#### Retrieve {#retrieve}
355354

@@ -443,16 +442,6 @@ This operation corresponds to the **CohereEmbedOptions_Extension_Create** microf
443442
| --- | --- |
444443
| `GenAICommons.EmbeddingsOptions (object)`, `InputType (enumeration)`, `EmbeddingTypes (enumeration, optional)`, `Truncate (enumeration, optional)` | `CohereEmbedOptions_Extension (object)`|
445444

446-
#### Embeddings Options: Add Titan Embeddings Extension {#add-titan-embeddings-extension}
447-
448-
Use this microflow to add a new TitanEmbeddingsOptions_Extension object to your `EmbeddingsOptions` object. You can use it to include parameters that are unique to Titan Embeddings models.
449-
450-
This operation corresponds to the **TitanEmbeddingsOptions_Extension_Create** microflow.
451-
452-
| Input | Output |
453-
| --- | --- |
454-
| `GenAICommons.EmbeddingsOptions (object)`, `Normalize (boolean)`| `TitanEmbeddingsOptions_Extension (object)`|
455-
456445
#### Set Bedrock Retrieve Options {#add-r-extension}
457446

458447
Use this microflow to add a new RetrieveRequest_Extension object to your request. This is required in order to use the [Retrieve](#retrieve) activity.

0 commit comments

Comments
 (0)