You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+2-4Lines changed: 2 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -17,7 +17,7 @@
17
17
18
18
## Introduction
19
19
20
-
Model API is a set of wrapper classes for particular tasks and model architectures, simplifying data preprocess and postprocess as well as routine procedures (model loading, asynchronous execution, etc.). It is aimed at simplifying end-to-end model inference for different deployment scenarios, including local execution and serving. The Model API is based on the OpenVINO inference API.
20
+
Model API is a set of wrapper classes for particular tasks and model architectures, simplifying data preprocess and postprocess as well as routine procedures (model loading, asynchronous execution, etc.). It is aimed at simplifying end-to-end model inference. The Model API is based on the OpenVINO inference API.
21
21
22
22
## How it works
23
23
@@ -35,7 +35,6 @@ Training Extensions embed all the metadata required for inference into model fil
35
35
36
36
- Python API
37
37
- Synchronous and asynchronous inference
38
-
- Local inference and serving through the rest API
39
38
- Model preprocessing embedding for faster inference
40
39
41
40
## Installation
@@ -48,7 +47,6 @@ Training Extensions embed all the metadata required for inference into model fil
48
47
from model_api.models import Model
49
48
50
49
# Create a model wrapper from a compatible model generated by OpenVINO Training Extensions
51
-
# Use URL to work with OVMS-served model, e.g. "localhost:9000/models/ssdlite_mobilenet_v2"
There are usecases when it is not possible to modify an internal `ov::Model` and it is hidden behind `InferenceAdapter`. For example the model can be served using [OVMS](https://github.com/openvinotoolkit/model_server). `create_model()` can construct a model from a given `InferenceAdapter`. That approach assumes that the model in `InferenceAdapter` was already configured by `create_model()` called with a string (a path or a model name). It is possible to prepare such model:
61
+
There are usecases when it is not possible to modify an internal `ov::Model` and it is hidden behind `InferenceAdapter`. `create_model()` can construct a model from a given `InferenceAdapter`. That approach assumes that the model in `InferenceAdapter` was already configured by `create_model()` called with a string (a path or a model name). It is possible to prepare such model:
64
62
65
63
```python
66
64
model = DetectionModel.create_model("~/.cache/omz/public/ssdlite_mobilenet_v2/FP16/ssdlite_mobilenet_v2.xml")
Copy file name to clipboardExpand all lines: src/README.md
+1-13Lines changed: 1 addition & 13 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -79,25 +79,13 @@ The following tasks can be solved with wrappers usage:
79
79
80
80
Model API wrappers are executor-agnostic, meaning it does not implement the specific model inference or model loading, instead it can be used with different executors having the implementation of common interface methods in adapter class respectively.
81
81
82
-
Currently, `OpenvinoAdapter` and `OVMSAdapter` are supported.
82
+
Currently, `OpenvinoAdapter` and `ONNXRuntimeAdapter` are supported.
83
83
84
84
### OpenVINO Adapter
85
85
86
86
`OpenvinoAdapter` hides the OpenVINO™ toolkit API, which allows Model API wrappers launching with models represented in Intermediate Representation (IR) format.
87
87
It accepts a path to either `xml` model file or `onnx` model file.
88
88
89
-
### OpenVINO Model Server Adapter
90
-
91
-
`OVMSAdapter` hides the OpenVINO Model Server python client API, which allows Model API wrappers launching with models served by OVMS.
92
-
93
-
Refer to **[`OVMSAdapter`](adapters/ovms_adapter.md)** to learn about running demos with OVMS.
94
-
95
-
For using OpenVINO Model Server Adapter you need to install the package with extra module:
96
-
97
-
```sh
98
-
pip install <omz_dir>/demos/common/python[ovms]
99
-
```
100
-
101
89
### ONNXRuntime Adapter
102
90
103
91
`ONNXRuntimeAdapter` hides the ONNXRuntime, which Model API wrappers launching with models represented in ONNX format.
0 commit comments