18 lines (11 loc) · 1.16 KB

Interact with OpenVINO Model Server using Python

OpenVINO Model Server exposes network interface that client applications can interact with.

There's also tensorflow-serving-api package that can be used to send requests to OpenVINO Model Server.

Note: tensorflow-serving-api comes with tensorflow dependency which makes the package heavy.

There are sample scripts for tensorflow-serving-api:

tensorflow-serving-api samples

Additionally, starting with the 2022.2 release, OpenVINO Model Server also supports KServe API calls. You can try it out with the:

KServe samples

For generative AI use cases OVMS exposes an OpenAI-compatible REST API. Python samples for chat completions are available at:

OpenAI API samples

Note: 2025.3 is the last release that includes ovmsclient and it is not supported anymore. If you still need it, use release 2025.3