Skip to content

Commit 5383440

Browse files
authored
Merge pull request #91 from beehive-lab/docks/readme-jbang
Add JBang catalog and local usage examples to README.md
2 parents 9e330ee + c956dae commit 5383440

1 file changed

Lines changed: 14 additions & 0 deletions

File tree

README.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -255,6 +255,20 @@ You can run llama-tornado as a pure Java script using [JBang](https://www.jbang.
255255

256256
### Quick Start with JBang
257257

258+
Use from catalog:
259+
260+
```bash
261+
# Install JBang (if not already installed)
262+
curl -Ls https://sh.jbang.dev | bash -s - app setup
263+
264+
# Run GPULlama3.java CLI
265+
jbang gpullama3@beehive-lab -m model.gguf -p "Tell me a joke"
266+
267+
# Or install it as a command
268+
jbang app install gpullama3@beehive-lab
269+
gpullama3 -m model.gguf -p "Hello!"
270+
```
271+
or the local:
258272
```bash
259273
# Basic usage - interactive chat mode
260274
jbang LlamaTornadoCli.java -m beehive-llama-3.2-1b-instruct-fp16.gguf --interactive

0 commit comments

Comments
 (0)