Should mention that the sum of maxInputTokens and maxOutputTokens must be less than or equal to the context window for the setting of BYOK models.
Although it is implicitly explained in the code sample of the extension API document, we should explicitly explain in the BYOK setting document.
maxInputTokens: model.contextWindow - model.maxOutput,
Context:
Should mention that the sum of
maxInputTokensandmaxOutputTokensmust be less than or equal to the context window for the setting of BYOK models.Although it is implicitly explained in the code sample of the extension API document, we should explicitly explain in the BYOK setting document.
Context:
finish_reason: "length"violently crash with "Response too long" instead of rendering generated text vscode#319592 (comment)