Skip to content

Commit 71c8cbe

Browse files
Update titles and improve clarity in LiteRT documentation
1 parent 61d4c41 commit 71c8cbe

2 files changed

Lines changed: 11 additions & 20 deletions

File tree

content/learning-paths/mobile-graphics-and-gaming/litert-sme/1-litert-kleidiai-sme2.md

Lines changed: 4 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -1,24 +1,20 @@
11
---
2-
title: Understand LiteRT, XNNPACK, KleidiAI and SME2
2+
title: Understand LiteRT, XNNPACK, KleidiAI, and SME2
33
weight: 2
44

55
### FIXED, DO NOT MODIFY
66
layout: learningpathall
77
---
88

9-
## LiteRT, XNNPACK, KleidiAI and SME2
9+
## LiteRT, XNNPACK, KleidiAI, and SME2
1010

11-
LiteRT (Lite Runtime), formerly known as TensorFlow Lite, is a runtime for on-device AI.
12-
The default CPU acceleration library used by LiteRT is XNNPACK.
11+
LiteRT (Lite Runtime, formerly TensorFlow Lite) is a runtime for on-device AI on Arm platforms. The default CPU acceleration library used by LiteRT is XNNPACK (an open-source library providing highly optimized neural-network operators).
1312

1413
XNNPACK is an open-source library that provides highly optimized implementations of neural-network operators. It continuously integrates KleidiAI library to leverage new CPU features such as SME2.
1514

1615
KleidiAI is a library developed by Arm that offers performance-critical micro-kernels leveraging Arm architecture features, such as SME2.
1716

18-
Both XNNPACK and KleidiAI are external dependencies of LiteRT. LiteRT specifies the versions of these libraries to use.
19-
When LiteRT is built with both XNNPACK and KleidiAI enabled, XNNPACK invokes KleidiAI’s micro-kernels at runtime to accelerate operators with supported data types; otherwise, it falls back to its own implementation.
20-
21-
The software stack for LiteRT is as follows.
17+
The software stack for LiteRT is shown below.
2218

2319
![LiteRT, XNNPACK, KleidiAI and SME2#center](./litert-sw-stack.png "LiteRT, XNNPACK, KleidiAI and SME2")
2420

content/learning-paths/mobile-graphics-and-gaming/litert-sme/_index.md

Lines changed: 7 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -1,24 +1,19 @@
11
---
22
title: Accelerate LiteRT Models on Android with KleidiAI and SME2
33

4-
draft: true
5-
cascade:
6-
draft: true
7-
84
minutes_to_complete: 30
95

10-
who_is_this_for: This is an advanced topic for developers looking to leverage the Arm's Scalable Matrix Extension Version 2 (SME2) instructions to accelerate LiteRT models inference on Android.
6+
who_is_this_for: This is an advanced topic for developers looking to leverage Arm's Scalable Matrix Extension version 2 (SME2) instructions to accelerate LiteRT model inference on Android.
117

128
learning_objectives:
13-
- Understand how KleidiAI works in LiteRT.
14-
- Build the LiteRT benchmark tool and enable XNNPACK and KleidiAI with SME2 support in LiteRT.
15-
- Create LiteRT models that can be acclerated by SME2 through KleidiAI.
16-
- Use the benchmark tool to evaluate and validate the SME2 acceleration performance of LiteRT models.
17-
9+
- Understand how KleidiAI integrates with LiteRT
10+
- Build the LiteRT benchmark tool and enable XNNPACK and KleidiAI with SME2 support in LiteRT
11+
- Create LiteRT models that can be accelerated by SME2 through KleidiAI
12+
- Use the benchmark tool to evaluate and validate the SME2 acceleration performance of LiteRT models
1813

1914
prerequisites:
20-
- An x86_64 Linux development machine.
21-
- An Android device that supports the Arm SME2 architecture features - see the list of [devices with SME2 support](/learning-paths/cross-platform/multiplying-matrices-with-sme2/1-get-started/#devices)
15+
- An Arm64 Linux development machine
16+
- An Android device that supports Arm SME2 architecture features - see the list of [devices with SME2 support](/learning-paths/cross-platform/multiplying-matrices-with-sme2/1-get-started/#devices)
2217

2318
author: Jiaming Guo
2419

0 commit comments

Comments
 (0)