Skip to content

Commit 7b8bd75

Browse files
committed
Remove JBang vs llama-tornado comparison section from README.md
1 parent b624d57 commit 7b8bd75

1 file changed

Lines changed: 0 additions & 33 deletions

File tree

README.md

Lines changed: 0 additions & 33 deletions
Original file line numberDiff line numberDiff line change
@@ -274,39 +274,6 @@ jbang LlamaTornadoCli.java -m beehive-llama-3.2-1b-instruct-fp16.gguf \
274274
--max-tokens 512
275275
```
276276

277-
### JBang vs llama-tornado Script
278-
279-
| Feature | JBang CLI | llama-tornado Script |
280-
|---------|-----------|---------------------|
281-
| **Installation** | No build required | Requires `mvn package` |
282-
| **Dependencies** | Auto-downloaded | Included in fat JAR |
283-
| **TornadoVM Setup** | Basic (via dependencies) | Full (via tornado command wrapper) |
284-
| **GPU Acceleration** | Limited | Full support with all TornadoVM optimizations |
285-
| **Use Case** | Quick experimentation, CPU inference | Production use, full GPU acceleration |
286-
287-
### How It Works
288-
289-
The `LlamaTornadoCli.java` file includes special JBang directives at the top:
290-
291-
```java
292-
//JAVA 21
293-
//PREVIEW
294-
//DEPS io.github.beehive-lab:gpu-llama3:0.3.1
295-
//DEPS io.github.beehive-lab:tornado-api:2.1.0
296-
//DEPS io.github.beehive-lab:tornado-runtime:2.1.0
297-
298-
//SOURCES TornadoFlags.java
299-
```
300-
301-
These directives tell JBang to:
302-
- Use Java 21 with preview features
303-
- Download the required Maven dependencies automatically
304-
- Load TornadoVM configuration from `TornadoFlags.java`
305-
306-
The `TornadoFlags.java` file contains all TornadoVM-specific JVM configuration (module exports, runtime settings, etc.), keeping the main CLI file clean and maintainable. This follows the same pattern as the [TornadoVM JBang examples](https://gist.github.com/maxandersen/14ecdc03c7c57fc59dfeb7ba37dd4c9c).
307-
308-
**Note**: For full GPU acceleration with all TornadoVM optimizations, we recommend using the `llama-tornado` script instead, which properly configures all TornadoVM runtime parameters.
309-
310277
-----------
311278

312279
## Collection of Tested Models

0 commit comments

Comments
 (0)