You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/en/docs/appstore/use-content/platform-supported-content/modules/genai/mendix-cloud-genai/navigate_mxgenai.md
+11-3Lines changed: 11 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -20,19 +20,27 @@ GenAI resource packs accelerate the delivery of complete generative AI solutions
The **Settings** tab contains the details of a GenAI resource. It shows the following:
25
24
26
25
***Display Name**: indicates the name of the resource.
27
26
***ID**: indicates the resource ID.
28
-
***Region**: the region where the resource is hosted.
27
+
***Region(s)**: the region where the resource is hosted.
28
+
***Cross Region Inference (CRI)**: shows if the model supports cross-region inference.
29
29
***Cloud Provider**: indicates the cloud provider, for example, AWS.
30
30
***Type**: this is the type of resource, for example, Text Generation, Embedding, Knowledge Base, etc.
31
31
***Model**: indicates which model is used, for example, Anthropic Claude Sonnet 3.5.
32
32
***Plan**: indicates the subscription plan used for compute resources (for example, embedding or text generation resources).
33
33
***Environment**: shows which environment is used, for example, test, acceptance, or production.
34
34
35
-
When you are looking at the knowledge base resource settings, you will also see details of the associated embeddings resource and vice versa. To learn more about embeddings, see the [Embedding vector](/appstore/modules/genai/rag/#embedding-vector) section of *RAG in a Mendix App*.
35
+
When you are looking at the knowledge base resource settings, you will also see details of the associated embeddings resource and vice versa. To learn more about embeddings, see the [Embedding vector](/appstore/modules/genai/rag/#embedding-vector) section of *RAG in a Mendix App*.
36
+
37
+
#### Cross-Region Inference (CRI)
38
+
39
+
Cross-region inference (CRI) allows a model to redirect requests to another region, helping to distribute the load across multiple regions. Connecting to a cross-region inference profile does not change how the request is sent; the redirection happens on the server side, determining the region to handle the request to get the fastest response.
40
+
41
+
For more details on how CRI can help increase throughput, see [Increase throughput with cross-Region inference](https://docs.aws.amazon.com/bedrock/latest/userguide/cross-region-inference.html).
42
+
43
+
Currently, CRI is available for a limited number of models and can only be enabled for new resources. In some cases, certain models are available only through cross-region inference.
0 commit comments