ptq

Step-by-Step

This document is used to enable Tensorflow SavedModel format using Intel® Neural Compressor for performance only.

Prerequisite

1. Installation

# Install Intel® Neural Compressor
pip install neural-compressor

2. Install Intel Tensorflow

pip install intel-tensorflow

Note: Supported Tensorflow >= 2.4.0.

3. Prepare Pretrained model

Download the model from tensorflow-hub.

image recognition

• mobilenetv1
• mobilenetv2
• efficientnet_v2_b0

Run Command

bash run_tuning.sh --config=./config.yaml --input_model=./SavedModel --output_model=./nc_SavedModel

bash run_benchmark.sh --config=./config.yaml --input_model=./SavedModel --mode=performance