Skip to content

Commit aa5112e

Browse files
letonghancogniware-devops
authored andcommitted
Refine AudioQnA compose file (opea-project#2203)
Signed-off-by: letonghan <letong.han@intel.com> Signed-off-by: cogniware-devops <ambarish.desai@cogniware.ai>
1 parent 56cf37a commit aa5112e

6 files changed

Lines changed: 25 additions & 9 deletions

File tree

AudioQnA/docker_compose/intel/cpu/xeon/compose.yaml

Lines changed: 7 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ services:
4242
LLM_SERVER_PORT: ${LLM_SERVER_PORT}
4343
VLLM_CPU_OMP_THREADS_BIND: all
4444
healthcheck:
45-
test: ["CMD-SHELL", "curl -f http://$host_ip:${LLM_SERVER_PORT}/health || exit 1"]
45+
test: ["CMD-SHELL", "curl -f http://localhost:80/health || exit 1"]
4646
interval: 10s
4747
timeout: 10s
4848
retries: 100
@@ -51,9 +51,12 @@ services:
5151
image: ${REGISTRY:-opea}/audioqna:${TAG:-latest}
5252
container_name: audioqna-xeon-backend-server
5353
depends_on:
54-
- whisper-service
55-
- vllm-service
56-
- speecht5-service
54+
whisper-service:
55+
condition: service_started
56+
speecht5-service:
57+
condition: service_started
58+
vllm-service:
59+
condition: service_healthy
5760
ports:
5861
- "3008:8888"
5962
environment:

AudioQnA/docker_compose/intel/cpu/xeon/compose_multilang.yaml

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -46,14 +46,21 @@ services:
4646
LLM_SERVER_PORT: ${LLM_SERVER_PORT}
4747
VLLM_CPU_OMP_THREADS_BIND: all
4848
healthcheck:
49-
test: ["CMD-SHELL", "curl -f http://$host_ip:${LLM_SERVER_PORT}/health || exit 1"]
49+
test: ["CMD-SHELL", "curl -f http://localhost:80/health || exit 1"]
5050
interval: 10s
5151
timeout: 10s
5252
retries: 100
5353
command: --model ${LLM_MODEL_ID} --host 0.0.0.0 --port 80
5454
audioqna-xeon-backend-server:
5555
image: ${REGISTRY:-opea}/audioqna-multilang:${TAG:-latest}
5656
container_name: audioqna-xeon-backend-server
57+
depends_on:
58+
whisper-service:
59+
condition: service_started
60+
gpt-sovits-service:
61+
condition: service_started
62+
vllm-service:
63+
condition: service_healthy
5764
ports:
5865
- "3008:8888"
5966
environment:

AudioQnA/docker_compose/intel/cpu/xeon/compose_tgi.yaml

Lines changed: 7 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@ services:
3939
HF_TOKEN: ${HF_TOKEN}
4040
LLM_SERVER_PORT: ${LLM_SERVER_PORT}
4141
healthcheck:
42-
test: ["CMD-SHELL", "curl -f http://$host_ip:${LLM_SERVER_PORT}/health || exit 1"]
42+
test: ["CMD-SHELL", "curl -f http://localhost:80/health || exit 1"]
4343
interval: 10s
4444
timeout: 10s
4545
retries: 100
@@ -48,9 +48,12 @@ services:
4848
image: ${REGISTRY:-opea}/audioqna:${TAG:-latest}
4949
container_name: audioqna-xeon-backend-server
5050
depends_on:
51-
- whisper-service
52-
- tgi-service
53-
- speecht5-service
51+
whisper-service:
52+
condition: service_started
53+
speecht5-service:
54+
condition: service_started
55+
tgi-service:
56+
condition: service_healthy
5457
ports:
5558
- "3008:8888"
5659
environment:

AudioQnA/tests/test_compose_multilang_on_xeon.sh

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -55,6 +55,7 @@ function start_services() {
5555
sleep 5s
5656
n=$((n+1))
5757
done
58+
sleep 1m
5859
}
5960

6061

AudioQnA/tests/test_compose_on_xeon.sh

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -55,6 +55,7 @@ function start_services() {
5555
sleep 5s
5656
n=$((n+1))
5757
done
58+
sleep 1m
5859
}
5960

6061

AudioQnA/tests/test_compose_tgi_on_xeon.sh

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -47,6 +47,7 @@ function start_services() {
4747
sleep 5s
4848
n=$((n+1))
4949
done
50+
sleep 1m
5051
}
5152

5253

0 commit comments

Comments
 (0)