Skip to content

Commit f069d8f

Browse files
ddh0xiukeding
authored andcommitted
common : add LLAMA_ARG_SPEC_TYPE (ggml-org#20744)
1 parent e49b2d0 commit f069d8f

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

common/arg.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3494,7 +3494,7 @@ common_params_context common_params_parser_init(common_params & params, llama_ex
34943494
throw std::invalid_argument("unknown speculative decoding type without draft model");
34953495
}
34963496
}
3497-
).set_examples({LLAMA_EXAMPLE_SERVER}));
3497+
).set_examples({LLAMA_EXAMPLE_SERVER}).set_env("LLAMA_ARG_SPEC_TYPE"));
34983498
add_opt(common_arg(
34993499
{"--spec-ngram-size-n"}, "N",
35003500
string_format("ngram size N for ngram-simple/ngram-map speculative decoding, length of lookup n-gram (default: %d)", params.speculative.ngram_size_n),

0 commit comments

Comments
 (0)