Skip to content

Should mention that the sum of maxInputTokens and maxOutputTokens must be less than or equal to the context window. #9936

Description

@tamuratak

Should mention that the sum of maxInputTokens and maxOutputTokens must be less than or equal to the context window for the setting of BYOK models.

Although it is implicitly explained in the code sample of the extension API document, we should explicitly explain in the BYOK setting document.

        maxInputTokens: model.contextWindow - model.maxOutput,

Context:

Metadata

Metadata

Assignees

No one assigned

    Labels

    doc-enhancementsuggested addition or improvement

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions