Search results

KV = KV_for_lora @ self.W_ukv ? not in the paper of deepseek

Status: Open.

#5 In ambisinister/mla-experiments;

· 8bitnand opened on Sep 8, 2025

LayerNorm or RMSNorm?

Status: Open.

#4 In ambisinister/mla-experiments;

· WessonZZ opened on May 26, 2025

Inference Peformance?

Status: Open.

#3 In ambisinister/mla-experiments;

· NoakLiu opened on Apr 9, 2025

Updated kv_cache?

Status: Open.

#2 In ambisinister/mla-experiments;

· toanbh10032 opened on Mar 3, 2025

MLA 35M RoPE vs MQA 32M RoPE

Status: Open.

#1 In ambisinister/mla-experiments;

· chaoyan1037 opened on Dec 31, 2024