Skip to content

Commit 7052187

Browse files
committed
update plugin references from DI v25.2.2-305-g2e9513c76
1 parent bf9f841 commit 7052187

20 files changed

Lines changed: 1028 additions & 727 deletions

data/plugins.json

Lines changed: 585 additions & 533 deletions
Large diffs are not rendered by default.

docs/build/reference/customtask/.pages

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -49,11 +49,12 @@ nav:
4949
- "Set or Overwrite parameters": cmem_plugin_parameters-ParametersPlugin.md
5050
- "SHACL validation with pySHACL": shacl-pyshacl.md
5151
- "SOQL query (Salesforce)": cmem_plugin_salesforce-SoqlQuery.md
52+
- "Spark SQL query": CustomSQLExecution.md
5253
- "SPARQL Construct query": sparqlCopyOperator.md
5354
- "SPARQL Select query": sparqlSelectOperator.md
5455
- "SPARQL Update query": sparqlUpdateOperator.md
5556
- "Split file": cmem_plugin_splitfile-plugin_splitfile-SplitFilePlugin.md
56-
- "SQL query": CustomSQLExecution.md
57+
- "SQL Update query": sqlUpdateQueryOperator.md
5758
- "Start Workflow per Entity": cmem_plugin_loopwf-task-StartWorkflow.md
5859
- "Store Vector Embeddings": cmem_plugin_pgvector-Store.md
5960
- "Unpivot": Unpivot.md

docs/build/reference/customtask/CustomSQLExecution.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,16 +1,16 @@
11
---
2-
title: "SQL query"
3-
description: "Executes a custom SQL query on the first input dataset and returns the result as its output."
2+
title: "Spark SQL query"
3+
description: "Executes a custom SQL query on the first input Spark dataframe and returns the result as its output."
44
icon: octicons/cross-reference-24
55
tags:
66
- WorkflowTask
77
---
8-
# SQL query
8+
# Spark SQL query
99
<!-- This file was generated - DO NOT CHANGE IT MANUALLY -->
1010

1111

1212

13-
Executes a custom SQL query on the first input dataset and returns the result as its output.
13+
Executes a custom SQL query on the first input Spark dataframe and returns the result as its output.
1414

1515

1616
## Parameter

docs/build/reference/customtask/cmem_plugin_kubernetes-Execute.md

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -75,6 +75,16 @@ Pods are an abstraction that represent groups of one or more application contain
7575

7676

7777

78+
### Container
79+
80+
In case there is more than one container in the pod OR the default container selection does not work, you need to specify the container ID in addition to the pod ID.
81+
82+
- ID: `container`
83+
- Datatype: `string`
84+
- Default Value: `None`
85+
86+
87+
7888
### Command
7989

8090
The command to execute.

docs/build/reference/customtask/cmem_plugin_llm-CreateEmbeddings.md

Lines changed: 29 additions & 20 deletions
Original file line numberDiff line numberDiff line change
@@ -16,28 +16,17 @@ tags:
1616
e.g. with cmemc.
1717

1818

19-
This plugin creates vector embeddings from text data using OpenAI's embeddings API.
19+
This plugin creates vector embeddings from text data using an OpenAI compatible embeddings API.
2020
It processes input entities containing text data and generates high-dimensional vector
2121
representations that capture semantic meaning.
2222

2323
## Features
2424

25-
- Supports OpenAI embeddings models (e.g., text-embedding-3-small)
25+
- Supports OpenAI embeddings models (e.g., `text-embedding-3-small`)
2626
- Batch processing for efficient API usage
2727
- Configurable input/output paths
28-
- Automatic schema generation based on configuration
2928
- Built-in error handling and workflow cancellation support
3029

31-
## Configuration
32-
33-
- **URL**: OpenAI API endpoint (default: https://api.openai.com/v1)
34-
- **API Key**: Your OpenAI API key for authentication
35-
- **Model**: The embedding model to use (e.g., text-embedding-3-small)
36-
- **Timeout**: Request timeout in milliseconds (default: 10000)
37-
- **Buffer Size**: Number of texts to process per batch (default: 100)
38-
- **Input Paths**: Comma-separated list of entity paths to embed (default: "text")
39-
- **Output Paths**: Configurable paths for embedding vectors and source text
40-
4130
## Input/Output
4231

4332
- **Input**: Entities with text data in specified paths
@@ -56,27 +45,37 @@ representations that capture semantic meaning.
5645

5746
### Base URL
5847

59-
URL of the OpenAI API (without endpoint path and without trailing slash)
48+
The base URL of the OpenAI compatible API (without endpoint path).
6049

6150
- ID: `base_url`
6251
- Datatype: `string`
63-
- Default Value: `https://api.openai.com/v1`
52+
- Default Value: `https://api.openai.com/v1/`
53+
54+
55+
56+
### API Type
57+
58+
Select the API client type. This determines the authentication method and endpoint configuration used for API requests. Choose `OPENAI` for direct OpenAI API access or `AZURE_OPENAI` for Azure-hosted OpenAI services. Consider using the API version advanced parameter in case you access Azure-hosted OpenAI services.
59+
60+
- ID: `api_type`
61+
- Datatype: `enumeration`
62+
- Default Value: `OPENAI`
6463

6564

6665

67-
### The OpenAI API key
66+
### API key
6867

69-
Fill the OpenAI API key if needed (or give a dummy value in case you access an unsecured endpoint).
68+
An optional API key for authentication.
7069

7170
- ID: `api_key`
7271
- Datatype: `password`
7372
- Default Value: `None`
7473

7574

7675

77-
### The embeddings model, e.g. text-embedding-3-small
76+
### Embeddings model
7877

79-
The embeddings model to use (e.g., text-embedding-3-small).
78+
The identifier of the embeddings model to use. Available model IDs for some public providers can be found here: [Claude](https://docs.claude.com/en/docs/build-with-claude/embeddings#available-models), [OpenAI](https://platform.openai.com/docs/guides/embeddings#embedding-models).
8079

8180
- ID: `model`
8281
- Datatype: `string`
@@ -108,9 +107,19 @@ Paths from input entities to forward to output without modification. These paths
108107

109108
## Advanced Parameter
110109

111-
### Timeout (Single Request, in Milliseconds)
110+
### API Version
111+
112+
Azure OpenAI API version (only used when API Type is `AZURE_OPENAI`). For more information about OpenAI API version at Azure, please see [the documentation](https://learn.microsoft.com/en-gb/azure/ai-foundry/openai/api-version-lifecycle).
113+
114+
- ID: `api_version`
115+
- Datatype: `string`
116+
- Default Value: `None`
117+
118+
112119

120+
### Timeout (milliseconds)
113121

122+
The timeout for a single API request in milliseconds.
114123

115124
- ID: `timout_single_request`
116125
- Datatype: `Long`

0 commit comments

Comments
 (0)