Skip to content
Integration Quarkus-LangChain4j

Add Prefill–Decode Separation with Batched Prompt Ingestion and Logits Skipping #53

Sign in to view logs

Add Prefill–Decode Separation with Batched Prompt Ingestion and Logits Skipping

Add Prefill–Decode Separation with Batched Prompt Ingestion and Logits Skipping #53

Run time

Learn about OS pricing on GitHub Actions
Job Run time
quarkus-integration-test (opencl)
3m 20s
quarkus-integration-test (ptx)
2m 27s
5m 47s