gateway 500 Internal Server Error

[sgz9527]

Component

Other

Describe the bug

/llm-d-deployer/quickstart# curl -v http://localhost:8081/v1/models \

-H 'accept: application/json'
-H 'Content-Type: application/json'

• Host localhost:8081 was resolved.
• IPv6: ::1
• IPv4: 127.0.0.1
• Trying [::1]:8081...
• Connected to localhost (::1) port 8081

GET /v1/models HTTP/1.1
Host: localhost:8081
User-Agent: curl/8.9.1
accept: application/json
Content-Type: application/json

• Request completely sent off
  < HTTP/1.1 500 Internal Server Error
  < date: Fri, 18 Jul 2025 10:14:38 GMT
  < server: istio-envoy
  < content-length: 0
  <
• Connection #0 to host localhost left intact

Steps to reproduce

1 run llmd-installer.sh,
2 test GET /v1/models via the gateway ,but i do it in this way
2.1 in k8s master node(btw my cluster is only one node), "kubectl port-forward -n llm-d service/llm-d-inference-gateway-istio 8081:80"
2.2 "curl -v http://localhost:8081/v1/models"

Additional context or screenshots

No response