Closes ROCm#672. Prefix caching now defaults to on for both the `Config` dataclass and the `EngineArgs` CLI surface, matching the default of every other major serving runtime. The CLI flag uses argparse's `BooleanOptionalAction`, so users can opt out with `--no-enable-prefix-caching` (or the underscore alias). The original `--enable_prefix_caching` form is preserved for backward compatibility. Note: `Qwen3NextMTP` asserts `enable_prefix_caching=False`, so users serving that model must pass `--no-enable-prefix-caching` explicitly. The plugin (sgl OOT) path is unchanged and continues to force-disable prefix caching since sgl manages its own. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

Commits

Commits on May 11, 2026

[feat] Enable prefix caching by default

Merge branch 'main' into enable-prefix-caching-by-default

Commits on May 12, 2026

Merge branch 'main' into enable-prefix-caching-by-default

Address review: auto-fallback prefix caching for MTP, add CLI test