Skip to content

Commit 572f023

Browse files
authored
Qualcomm AI Engine Direct - Remove SKILL.md info related to AIHub and README (#19143)
1 parent 0a4756a commit 572f023

3 files changed

Lines changed: 2 additions & 18 deletions

File tree

.claude/skills/qualcomm/SKILL.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -93,6 +93,5 @@ Required flags: `-m` (SoC model), `-b` (Android build dir). Optional: `-s` (devi
9393
| `TestExampleLLMScript` | LLM script tests |
9494
| `TestExampleMultimodalityScript` | Multimodality script tests |
9595
| `TestExampleOssScript` | OSS model script tests |
96-
| `TestExampleQaihubScript` | QAI Hub script tests |
9796
| `TestExampleScript` | General example script tests |
9897
| `TestUtilsScript` | Utility script tests |

backends/qualcomm/README.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -61,7 +61,6 @@ backends/qualcomm
6161
examples/qualcomm
6262
├── executor_runner # A general runner that is capable of running most of the basic models.
6363
├── oss_scripts # Scripts for OSS(Open Source Software) models and customized runner for some specific models.
64-
├── qaihub_scripts # Scripts for Qaihub models and corresponding customized runner for these models.
6564
└── scripts # Scripts for models provided by executorch.
6665
```
6766

examples/qualcomm/README.md

Lines changed: 2 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -9,12 +9,9 @@ We have separated the example scripts into the following subfolders, please refe
99
2. oss_scripts: OSS stands for Open Source Software. This folder contains python scripts for open source models. Some models under this folder might also have their own customized runner.
1010
For example, [llama](oss_scripts/llama/qnn_llama_runner.cpp) contains not only the python scripts to prepare the model but also a customized runner for executing the model.
1111

12-
3. qaihub_scripts: QAIHub stands for [Qualcomm AI Hub](https://aihub.qualcomm.com/). On QAIHub, users can find pre-compiled context binaries, a format used by QNN to save its models. This provides users with a new option for model deployment. Different from oss_scripts & scripts, which the example scripts are converting a model from nn.Module to ExecuTorch .pte files, qaihub_scripts provides example scripts for converting pre-compiled context binaries to ExecuTorch .pte files. Additionally, users can find customized example runners specific to the QAIHub models for execution. For example [qaihub_llama2_7b](qaihub_scripts/llama/llama2/qaihub_llama2_7b.py) is a script converting context binaries to ExecuTorch .pte files, and [qaihub_llama2_7b_runner](qaihub_scripts/llama/llama2/qaihub_llama2_7b_runner.cpp) is a customized example runner to execute llama2 .pte files. Please be aware that context-binaries downloaded from QAIHub are tied to a specific QNN SDK version.
13-
Before executing the scripts and runner, please ensure that you are using the QNN SDK version that is matching the context binary. Please refer to [Check context binary version](#check-context-binary-version) for tutorial on how to check the QNN Version for a context binary.
12+
3. scripts: This folder contains scripts to build models provided by ExecuTorch.
1413

15-
4. scripts: This folder contains scripts to build models provided by ExecuTorch.
16-
17-
5. util_scripts: This folder includes tutorial example scripts designed to showcase the utilities we've developed. For example, we provide a debugging tool [qnn_intermediate_debugger](./util_scripts/qnn_intermediate_debugger_demo.py) that allow users to compare the intermediate outputs of QNNs V.S. CPUs. By reviewing these scripts, we aim to help users smoothly integrate these utilities into their own projects.
14+
4. util_scripts: This folder includes tutorial example scripts designed to showcase the utilities we've developed. For example, we provide a debugging tool [qnn_intermediate_debugger](./util_scripts/qnn_intermediate_debugger_demo.py) that allow users to compare the intermediate outputs of QNNs V.S. CPUs. By reviewing these scripts, we aim to help users smoothly integrate these utilities into their own projects.
1815

1916

2017

@@ -74,17 +71,6 @@ python mobilenet_v2.py -s <device_serial> -m "SM8550" -b path/to/build-android/
7471
python deeplab_v3.py -s <device_serial> -m "SM8550" -b path/to/build-android/ --download
7572
```
7673

77-
#### Check context binary version
78-
This is typically useful when users want to run any models under `qaihub_scripts`. When users retrieve context binaries from Qualcomm AI Hub, we need to ensure the QNN SDK used to run the `qaihub_scripts` is the same version as the QNN SDK that Qualcomm AI Hub used to compile the context binaries. To do so, please run the following script to retrieve the JSON file that contains the metadata about the context binary:
79-
```bash
80-
cd ${QNN_SDK_ROOT}/bin/x86_64-linux-clang
81-
./qnn-context-binary-utility --context_binary ${PATH_TO_CONTEXT_BINARY} --json_file ${OUTPUT_JSON_NAME}
82-
```
83-
After retrieving the json file, search in the json file for the field "buildId" and ensure it matches the `${QNN_SDK_ROOT}` you are using for the environment variable.
84-
If you run into the following error, that means the ${QNN_SDK_ROOT} that you are using is older than the context binary's QNN SDK version. In this case, please download a newer QNN SDK version.
85-
```
86-
Error: Failed to get context binary info.
87-
```
8874
## Model Structure
8975
This section outlines the essential APIs and utilities provided to streamline the process of model conversion, deployment, and evaluation on Qualcomm hardware using ExecuTorch. The official APIs can be found under [export_utils.py](../../backends/qualcomm/export_utils.py)
9076

0 commit comments

Comments
 (0)