Skip to content

Commit faff5aa

Browse files
committed
Fix mdformat on all documentation files
1 parent 5783a8b commit faff5aa

2 files changed

Lines changed: 12 additions & 2 deletions

File tree

.pre-commit-config.yaml

Lines changed: 11 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -57,7 +57,17 @@ repos:
5757
args: ['--number']
5858
additional_dependencies: [mdformat-myst, mdformat-ruff]
5959
files: (docs/.)
60-
exclude: docs/guides/checkpointing_solutions.md|docs/guides.md|docs/run_maxtext.md
60+
# Exclude all files that use complex MyST directives that mdformat breaks
61+
exclude: >
62+
(?x)^(
63+
docs/guides/checkpointing_solutions\.md|
64+
docs/guides\.md|
65+
docs/run_maxtext\.md|
66+
docs/guides/monitoring_and_debugging\.md|
67+
docs/reference/core_concepts.md|
68+
docs/reference/architecture.md|
69+
docs/reference/models.md
70+
)$
6171
6272
- repo: https://github.com/adrienverge/yamllint
6373
rev: v1.35.0

docs/reference/core_concepts/moe_configuration.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -99,7 +99,7 @@ Dropping:
9999

100100
`mlp_bias`: If enabled, add learnable bias terms for MLP matmul. Originally implemented to support the GPT-OSS model architecture.
101101

102-
`prefuse_moe_weights`: If enabled alongside `sparse_matmul=True`, fuses the two FFN1 grouped GEMMs (wi\_0 and wi\_1) into a single grouped GEMM call. Expert weights are stored in a concatenated `(num_experts, embed_dim, 2 * mlp_dim)` shape, so input activations are loaded from HBM once per forward pass instead of twice. Backend-agnostic (works with Megablox, JAX Ragged Dot, and Tokamax). When used with `attention=vllm_rpa`, the fused weight tensor is passed directly to the vLLM-TPU serving kernel without splitting.
102+
`prefuse_moe_weights`: If enabled alongside `sparse_matmul=True`, fuses the two FFN1 grouped GEMMs (wi_0 and wi_1) into a single grouped GEMM call. Expert weights are stored in a concatenated `(num_experts, embed_dim, 2 * mlp_dim)` shape, so input activations are loaded from HBM once per forward pass instead of twice. Backend-agnostic (works with Megablox, JAX Ragged Dot, and Tokamax). When used with `attention=vllm_rpa`, the fused weight tensor is passed directly to the vLLM-TPU serving kernel without splitting.
103103

104104
`use_batch_split_schedule` (experimental): If enabled, split batch into micro-batches to hide communications that yields performance benefits.
105105

0 commit comments

Comments
 (0)