Skip to content

Commit 538d4d5

Browse files
fix: increase repetition_penalty to 1.3 — 100-step adapter is prone to loops
1 parent 6719ef4 commit 538d4d5

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

src/backends/inference/request.rs

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -98,7 +98,7 @@ impl Default for GenerationParams {
9898
top_p: 0.92,
9999
top_k: 64,
100100
max_tokens: 2048,
101-
repetition_penalty: 1.15,
101+
repetition_penalty: 1.3,
102102
contrastive_alpha: 0.0,
103103
kv_quant_preference: None,
104104
}

0 commit comments

Comments
 (0)