You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/en/docs/marketplace/genai/mendix-cloud-genai/Mx GenAI Connector.md
+15-14Lines changed: 15 additions & 14 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -12,20 +12,19 @@ aliases:
12
12
13
13
The [Mendix Cloud GenAI connector](https://marketplace.mendix.com/link/component/239449) lets you utilize [Mendix Cloud GenAI resource packs](/appstore/modules/genai/mx-cloud-genai/mendix-cloud-grp/) directly within your Mendix application. It allows you to integrate generative AI by dragging and dropping common operations from its toolbox.
14
14
15
-
16
15
### Features
17
16
18
17
In the current version, Mendix supports text generation (including function/tool calling, chat with images, and chat with documents), vector embedding generation, knowledge base storage, and retrieval of knowledge base chunks.
19
18
20
-
Typical use cases for generative AI are described in more detail [here](/appstore/modules/genai/get-started/#llm-use-cases).
19
+
Typical use cases for generative AI are described in more detail in the [Typical LLM Use Cases](/appstore/modules/genai/get-started/#llm-use-cases) section of the *GenAI Concepts*.
21
20
22
21
### Prerequisites
23
22
24
-
To use this connector, you need configuration keys to authenticate to the Mendix Cloud GenAI services. You can generate keys in the [Mendix portal](https://genai.home.mendix.com) or ask someone with access to either generate them for you or add you to their team so you can generate keys yourself.
23
+
To use this connector, you need configuration keys to authenticate to the Mendix Cloud GenAI services. You can generate keys in the [Mendix Cloud GenAI Portal](https://genai.home.mendix.com) or ask someone with access to either generate them for you or add you to their team so you can generate keys yourself.
25
24
26
25
{{% alert color="info" %}}
27
26
28
-
The Mendix Cloud GenAI Connector module generates embeddings internally when interacting with a knowledge base. This means that you do not need to create embedding keys yourself when interacting with a Mendix Cloud knowledge base. Pure embedding operations are only required if additional processes, such as using the generated vectors instead of text, are needed. For example, a similar search algorithm could use vector distances to calculate relatedness.
27
+
The Mendix Cloud GenAI Connector module generates embeddings internally when interacting with a knowledge base. This means that you do not need to create embedding keys yourself when interacting with a Mendix Cloud knowledge base. Direct embedding operations are only required if additional processes, such as, using the generated vectors instead of text, are needed. For example, a similar search algorithm could use vector distances to calculate relatedness.
29
28
30
29
{{% /alert %}}
31
30
@@ -48,10 +47,10 @@ Follow the steps below to get started:
48
47
* Make sure to configure the [Encryption module](/appstore/modules/encryption/#configuration) before you connect your app to Mendix Cloud GenAI.
49
48
* Add the module role `MxGenAIConnector.Administrator` to your Administrator **User roles** in the **Security** settings of your app.
50
49
* Add the `Configuration_Overview` page (**USE_ME** > **Configuration**) to your navigation, or add the `Snippet_Configuration` to a page that is already part of your navigation. Alternatively, you can register your key by using the `Configuration_RegisterByString` microflow.
51
-
* Complete the runtime setup of Mendix Cloud GenAI configuration by navigating to the page mentioned above. Import a key generated in the [portal](https://genai.home.mendix.com) or provided to you and click **Test Key** to validate its functionality. Note that this key establishes a connection between the Mendix Cloud resources and your application. It contains all the information required to set up the connection.
50
+
* Complete the runtime setup of Mendix Cloud GenAI configuration by navigating to the page mentioned above. Import a key generated in the [Mendix Cloud GenAI Portal](https://genai.home.mendix.com) or provided to you and click **Test Key** to validate its functionality. Note that this key establishes a connection between the Mendix Cloud resources and your application. It contains all the information required to set up the connection.
52
51
53
52
{{% alert color="info" %}}
54
-
When using an Embeddings Mdel Resource in combination with a Knowledge Base Resource, there is no need to import both keys: the connection details for the embeddings generation model will be generated automatically on import of the Knowledge Base Resource key.
53
+
When using an Embeddings Model Resource together with a Knowledge Base Resource, you do not need to import both keys. Importing the Knowledge Base Resource key automatically generates the connection details for the embeddings generation model.
55
54
{{% /alert %}}
56
55
57
56
## Operations
@@ -62,15 +61,14 @@ Configuration keys are stored persistently after they are imported (either via t
62
61
63
62
To use the operations, either a `DeployedModel` (text, embeddings) or a `DeployedKnowledgeBase` must always be passed as input.
64
63
65
-
####How to get the Deployed Model in scope
64
+
### How to get the `DeployedModel` in scope
66
65
67
-
The DeployedModel will be created automatically when importing keys at runtime and needs to be retrieved from the database.
66
+
The `DeployedModel` object will be created automatically when importing keys at runtime and needs to be retrieved from the database.
68
67
69
-
####How to get the Deployed Knowledge Base in scope
68
+
### How to get the `DeployedKnowledgeBase` in scope
70
69
71
70
In Mendix Cloud GenAI, a single knowledge base resource (`MxCloudKnowledgeBaseResource`) can contain multiple `DeployedKnowledgeBase` objects (tables, referred to as 'collections'). As a result, several collections may belong to the same resource. You can use the `DeployedKnowledgeBase: Get` toolbox action to retrieve the right collection and initialize a knowledge base operation. It requires the `Collection.Name` (string) as input (which is usually different from the `Collection.DisplayName` attribute).
72
71
73
-
74
72
### Chat Completions Operation
75
73
76
74
After following the general setup above, you are ready to use the chat completions microflows in the GenAICommons and MxGenAIConnector modules. You can find `Chat Completions (without history)` and `Chat Completions (with history)` in the **Text & Files** folder of the GenAICommons. The chat completions microflows are also exposed as microflow actions under the **GenAI (Generate)** category inside of the **Toolbox**.
@@ -150,7 +148,7 @@ The model uses the file name when analyzing documents, which may introduce a pot
150
148
151
149
A Knowledge Base resource can comprise several collections. Each collection is specifically designed to hold numerous documents, serving as a logical grouping for related information based on its shared domain, purpose, or thematic focus.
152
150
153
-
Below, you can find a diagram displaying the separation of a resource into different collections. Like this, different use cases can share the same resource while the option to only add the required collections to the conversation context is preserved. In example of this is the use cases 'Employee Onboarding' and 'IT Ticket Support' where both of them require knowledge about IT Setup & Equipment but Company Culture & Values knowledge is relevant for onboarding only and Historical Support ticket information only for IT support.
151
+
Below is a diagram showing how resources are organized into separate collections. This approach allows multiple use cases to share common resource while the option to only add the required collections to the conversation context is preserved. For example, both employee onboarding and IT ticket support require information about IT setup and equipment. However, only, onboarding needs knowledge about the company culture and values, while only IT support requires access to historical support ticket data.
@@ -162,10 +160,13 @@ Metadata is additional information that can be attached to data in a GenAI knowl
162
160
163
161
Metadata consists of key-value pairs and serves as additional information connected to the data, though it is not part of the vectorization itself.
164
162
165
-
To come back to the previous example for collections: Instead of having two different collections, such as 'IT Setup & Equipment' and 'Historical Support tickets', there could be one named 'Company IT'. To be able to retrieve only tickets and no other information from this collection, metadata like
166
-
* key: `Category`, value: `Ticket`
163
+
In the employee onboarding and IT ticket support example, instead of having two different collections, such as IT setup and equipment and historical support tickets, there could be one named 'Company IT'. To retrieve tickets only and no other information from this collection, add the below metadata during insertion.
164
+
165
+
```text
166
+
key: `Category`, value: `Ticket`
167
+
```
167
168
168
-
can be added during insertion. The model then generates its response using the specified metadata instead of solely the input text.
169
+
The model then generates its response using the specified metadata instead of solely the input text.
0 commit comments