Skip to content

Commit bd0748a

Browse files
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
1 parent ae30e1e commit bd0748a

13 files changed

Lines changed: 20 additions & 20 deletions

File tree

AudioQnA/docker_compose/intel/cpu/xeon/README.md

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -154,13 +154,13 @@ docker compose -f compose_tgi.yaml -f compose.monitoring.yaml down
154154

155155
In the context of deploying an AudioQnA pipeline on an Intel® Xeon® platform, we can pick and choose different large language model serving frameworks, or single English TTS/multi-language TTS component. The table below outlines the various configurations that are available as part of the application. These configurations can be used as templates and can be extended to different components available in [GenAIComps](https://github.com/opea-project/GenAIComps.git).
156156

157-
| File | Description |
158-
| -------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
159-
| [compose.yaml](./compose.yaml) | Default compose file using vllm as serving framework and redis as vector database |
160-
| [compose_tgi.yaml](./compose_tgi.yaml) | The LLM serving framework is TGI. All other configurations remain the same as the default |
161-
| [compose_multilang.yaml](./compose_multilang.yaml) | The TTS component is GPT-SoVITS. All other configurations remain the same as the default |
162-
| [compose_remote.yaml](./compose_remote.yaml) | The LLM used is hosted on a remote server and an endpoint is used to access this model. Additional environment variables need to be set before running. See [instructions](#running-llm-models-with-remote-endpoints) below. |
163-
| [compose.monitoring.yaml](./compose.monitoring.yaml) | Helper file for monitoring features. Can be used along with any compose files |
157+
| File | Description |
158+
| ---------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
159+
| [compose.yaml](./compose.yaml) | Default compose file using vllm as serving framework and redis as vector database |
160+
| [compose_tgi.yaml](./compose_tgi.yaml) | The LLM serving framework is TGI. All other configurations remain the same as the default |
161+
| [compose_multilang.yaml](./compose_multilang.yaml) | The TTS component is GPT-SoVITS. All other configurations remain the same as the default |
162+
| [compose_remote.yaml](./compose_remote.yaml) | The LLM used is hosted on a remote server and an endpoint is used to access this model. Additional environment variables need to be set before running. See [instructions](#running-llm-models-with-remote-endpoints) below. |
163+
| [compose.monitoring.yaml](./compose.monitoring.yaml) | Helper file for monitoring features. Can be used along with any compose files |
164164

165165
### Running LLM models with remote endpoints
166166

AudioQnA/docker_compose/intel/cpu/xeon/README_vllm.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -126,12 +126,12 @@ The following containers should be running:
126126

127127
Containers should not restart.
128128

129-
(Optional) Enabling monitoring using the commmand:
129+
(Optional) Enabling monitoring using the command:
130+
130131
```bash
131132
docker compose -f compose.yaml -f compose.monitoring.yaml up -d
132133
```
133134

134-
135135
#### 3.1.1. Configuring GPU forwarding
136136

137137
By default, in the Docker Compose file, compose_vllm.yaml is configured to forward all GPUs to the audioqna-vllm-service container.

AudioQnA/docker_compose/intel/cpu/xeon/compose.monitoring.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -56,4 +56,4 @@ services:
5656
ipc: host
5757
restart: always
5858
deploy:
59-
mode: global
59+
mode: global

AudioQnA/docker_compose/intel/cpu/xeon/grafana/dashboards/download_opea_dashboard.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,4 +9,4 @@ fi
99
wget https://raw.githubusercontent.com/opea-project/GenAIEval/refs/heads/main/evals/benchmark/grafana/vllm_grafana.json
1010
wget https://raw.githubusercontent.com/opea-project/GenAIEval/refs/heads/main/evals/benchmark/grafana/tgi_grafana.json
1111
wget https://raw.githubusercontent.com/opea-project/GenAIEval/refs/heads/main/evals/benchmark/grafana/audioqna_megaservice_grafana.json
12-
wget https://raw.githubusercontent.com/opea-project/GenAIEval/refs/heads/main/evals/benchmark/grafana/node_grafana.json
12+
wget https://raw.githubusercontent.com/opea-project/GenAIEval/refs/heads/main/evals/benchmark/grafana/node_grafana.json

AudioQnA/docker_compose/intel/cpu/xeon/grafana/provisioning/dashboards/local.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,4 +11,4 @@ providers:
1111
disableDeletion: false
1212
updateIntervalSeconds: 10 #how often Grafana will scan for changed dashboards
1313
options:
14-
path: /var/lib/grafana/dashboards
14+
path: /var/lib/grafana/dashboards

AudioQnA/docker_compose/intel/cpu/xeon/grafana/provisioning/datasources/datasource.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -51,4 +51,4 @@ datasources:
5151
tlsClientKey: "..."
5252
version: 1
5353
# <bool> allow users to edit datasources from the UI.
54-
editable: true
54+
editable: true

AudioQnA/docker_compose/intel/cpu/xeon/prometheus.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,4 +24,4 @@ scrape_configs:
2424
- job_name: "prometheus-node-exporter"
2525
metrics_path: /metrics
2626
static_configs:
27-
- targets: ["node-exporter:9100"]
27+
- targets: ["node-exporter:9100"]

AudioQnA/docker_compose/intel/hpu/gaudi/compose.monitoring.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -56,4 +56,4 @@ services:
5656
ipc: host
5757
restart: always
5858
deploy:
59-
mode: global
59+
mode: global

AudioQnA/docker_compose/intel/hpu/gaudi/grafana/dashboards/download_opea_dashboard.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,4 +9,4 @@
99
wget https://raw.githubusercontent.com/opea-project/GenAIEval/refs/heads/main/evals/benchmark/grafana/vllm_grafana.json
1010
wget https://raw.githubusercontent.com/opea-project/GenAIEval/refs/heads/main/evals/benchmark/grafana/tgi_grafana.json
1111
# wget https://raw.githubusercontent.com/opea-project/GenAIEval/refs/heads/main/evals/benchmark/grafana/audioqna_megaservice_grafana.json
12-
wget https://raw.githubusercontent.com/opea-project/GenAIEval/refs/heads/main/evals/benchmark/grafana/node_grafana.json
12+
wget https://raw.githubusercontent.com/opea-project/GenAIEval/refs/heads/main/evals/benchmark/grafana/node_grafana.json

AudioQnA/docker_compose/intel/hpu/gaudi/grafana/provisioning/dashboards/local.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,4 +11,4 @@ providers:
1111
disableDeletion: false
1212
updateIntervalSeconds: 10 #how often Grafana will scan for changed dashboards
1313
options:
14-
path: /var/lib/grafana/dashboards
14+
path: /var/lib/grafana/dashboards

0 commit comments

Comments
 (0)