Skip to content
Integration Quarkus-LangChain4j

Add Prefill–Decode Separation with Batched Prompt Ingestion and Logits Skipping #21

Sign in to view logs

Add Prefill–Decode Separation with Batched Prompt Ingestion and Logits Skipping

Add Prefill–Decode Separation with Batched Prompt Ingestion and Logits Skipping #21

Run time

Learn about OS pricing on GitHub Actions
Job Run time
quarkus-integration-test (opencl)
2m 20s
quarkus-integration-test (ptx)
1s
2m 21s