Skip to content

Commit 730aef1

Browse files
Copilotkirklandsign
andcommitted
Add model/tokenizer push instructions before Select Models section
Co-authored-by: kirklandsign <107070759+kirklandsign@users.noreply.github.com>
1 parent 078117c commit 730aef1

1 file changed

Lines changed: 12 additions & 0 deletions

File tree

llm/android/LlamaDemo/README.md

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -64,6 +64,18 @@ Select the settings widget to get started with picking a model, its parameters a
6464

6565

6666

67+
### Push Model and Tokenizer Files to Device
68+
69+
Before selecting a model and tokenizer in the app, you need to push these files to your Android device. Use the following commands to copy the model (`.pte`) and tokenizer files to the device:
70+
71+
```sh
72+
adb shell mkdir -p /data/local/tmp/llama
73+
adb push <your_model>.pte /data/local/tmp/llama
74+
adb push <your_tokenizer> /data/local/tmp/llama
75+
```
76+
77+
Replace `<your_model>.pte` with your exported model file and `<your_tokenizer>` with your tokenizer file (e.g., `tokenizer.bin` or `tokenizer.model`).
78+
6779
### Select Models and Parameters
6880

6981
Once you've selected the model, tokenizer, and model type you are ready to click on "Load Model" to have the app load the model and go back to the main Chat activity.

0 commit comments

Comments
 (0)