Skip to content
GPULlama3 Build & Run

Add Prefill–Decode Separation with Batched Prompt Ingestion and Logits Skipping #292

Sign in to view logs

Add Prefill–Decode Separation with Batched Prompt Ingestion and Logits Skipping

Add Prefill–Decode Separation with Batched Prompt Ingestion and Logits Skipping #292

Run time

Learn about OS pricing on GitHub Actions
Job Run time
code-quality
13s
build-and-run (ptx)
1m 7s
build-and-run (opencl)
18s
code-quality
13s
build-and-run (ptx)
12m 20s
build-and-run (opencl)
1s
build-and-run (opencl)
8m 29s
code-quality
13s
build-and-run (ptx)
12m 20s
35m 14s