Skip to content

Commit 4dfedb0

Browse files
committed
fix(kimi-k3): raise LLAMA_MAX_EXPERTS to 1024 for K3's 896 experts
Mirrors upstream PR 26185 commit cf11c4c. Without this the real checkpoint fails the n_expert assert at load; the synthetic test model (8 experts) never hit it.
1 parent f55f4b0 commit 4dfedb0

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

src/llama-hparams.h

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@
77

88
// bump if necessary
99
#define LLAMA_MAX_LAYERS 512
10-
#define LLAMA_MAX_EXPERTS 512 // Qwen3 Next
10+
#define LLAMA_MAX_EXPERTS 1024 // Kimi K3 has 896 experts
1111

1212
enum llama_expert_gating_func_type {
1313
LLAMA_EXPERT_GATING_FUNC_TYPE_NONE = 0,

0 commit comments

Comments
 (0)