Skip to content

Commit 2bcea79

Browse files
authored
Update 3-buid-model.md
1 parent 6d8b826 commit 2bcea79

1 file changed

Lines changed: 7 additions & 3 deletions

File tree

  • content/learning-paths/mobile-graphics-and-gaming/litert-sme

content/learning-paths/mobile-graphics-and-gaming/litert-sme/3-buid-model.md

Lines changed: 7 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -8,6 +8,7 @@ layout: learningpathall
88

99
### KleidiAI SME2 support in LiteRT
1010

11+
LiteRT uses XNNPACK as its default CPU backend. KleidiAI micro-kernels are integrated through XNNPACK in LiteRT.
1112
Only a subset of KleidiAI SME, SME2 micro-kernels has been integrated into XNNPACK.
1213
These micro-kernels support operators using the following data types and quantization configurations in the LiteRT model.
1314
Other operators are using XNNPACK’s default implementation during the inference.
@@ -44,9 +45,10 @@ Other operators are using XNNPACK’s default implementation during the inferenc
4445
| Asymmetric INT8 quantization | Per-channel or per-tensor symmetric INT8 quantization | Asymmetric INT8 quantization |
4546

4647

47-
### Create LiteRT models by Keras
48-
49-
To evaluate the performance of SME2 acceleration per operator, the following script is provided as an example. It uses the Keras to create a simple model containing only a single fully connected operator and convert it into the LiteRT model.
48+
### Create LiteRT models using Keras
49+
To demonstrate SME2 acceleration on Android, you will construct simple single-layer models (e.g., Fully Connected) using Keras and convert them into LiteRT (.tflite) format.
50+
This allows you to benchmark isolated operators and directly observe SME2 improvements.
51+
The following script is provided as an example:
5052

5153
``` python
5254
import tensorflow as tf
@@ -78,6 +80,8 @@ The model above is created in FP32 format. As mentioned in the previous section,
7880

7981
You can also optimize this Keras model using post-training quantization to create a LiteRT model that suits your requirements.
8082

83+
## Post-Training Quantization Options
84+
8185
* Post-training FP16 quantization
8286
``` python
8387
# Convert to model with FP16 weights and FP32 activations

0 commit comments

Comments
 (0)