Skip to content

Commit 1572ae9

Browse files
Merge pull request mendix#9639 from Michiel-Bijlsma/MB-GenAIPortalHowTo
Approved via slack
2 parents c23c1ec + e35664e commit 1572ae9

2 files changed

Lines changed: 11 additions & 3 deletions

File tree

  • content/en/docs/appstore/use-content/platform-supported-content/modules/genai/mendix-cloud-genai
  • static/attachments/appstore/platform-supported-content/modules/genai/navigate_mxgenai

content/en/docs/appstore/use-content/platform-supported-content/modules/genai/mendix-cloud-genai/navigate_mxgenai.md

Lines changed: 11 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -20,19 +20,27 @@ GenAI resource packs accelerate the delivery of complete generative AI solutions
2020
### Settings
2121

2222
{{< figure src="/attachments/appstore/platform-supported-content/modules/genai/navigate_mxgenai/GenAIResource_Settings.png" >}}
23-
2423
The **Settings** tab contains the details of a GenAI resource. It shows the following:
2524

2625
* **Display Name**: indicates the name of the resource.
2726
* **ID**: indicates the resource ID.
28-
* **Region**: the region where the resource is hosted.
27+
* **Region(s)**: the region where the resource is hosted.
28+
* **Cross Region Inference (CRI)**: shows if the model supports cross-region inference.
2929
* **Cloud Provider**: indicates the cloud provider, for example, AWS.
3030
* **Type**: this is the type of resource, for example, Text Generation, Embedding, Knowledge Base, etc.
3131
* **Model**: indicates which model is used, for example, Anthropic Claude Sonnet 3.5.
3232
* **Plan**: indicates the subscription plan used for compute resources (for example, embedding or text generation resources).
3333
* **Environment**: shows which environment is used, for example, test, acceptance, or production.
3434

35-
When you are looking at the knowledge base resource settings, you will also see details of the associated embeddings resource and vice versa. To learn more about embeddings, see the [Embedding vector](/appstore/modules/genai/rag/#embedding-vector) section of *RAG in a Mendix App*.
35+
When you are looking at the knowledge base resource settings, you will also see details of the associated embeddings resource and vice versa. To learn more about embeddings, see the [Embedding vector](/appstore/modules/genai/rag/#embedding-vector) section of *RAG in a Mendix App*.
36+
37+
#### Cross-Region Inference (CRI)
38+
39+
Cross-region inference (CRI) allows a model to redirect requests to another region, helping to distribute the load across multiple regions. Connecting to a cross-region inference profile does not change how the request is sent; the redirection happens on the server side, determining the region to handle the request to get the fastest response.
40+
41+
For more details on how CRI can help increase throughput, see [Increase throughput with cross-Region inference](https://docs.aws.amazon.com/bedrock/latest/userguide/cross-region-inference.html).
42+
43+
Currently, CRI is available for a limited number of models and can only be enabled for new resources. In some cases, certain models are available only through cross-region inference.
3644

3745
### Team
3846

-33.4 KB
Loading

0 commit comments

Comments
 (0)