Skip to content

llms/ollama: add WithTruncate option for context length handling#1469

Open
damz wants to merge 1 commit into
tmc:mainfrom
damz:pr/ollama-withtruncate
Open

llms/ollama: add WithTruncate option for context length handling#1469
damz wants to merge 1 commit into
tmc:mainfrom
damz:pr/ollama-withtruncate

Conversation

@damz

@damz damz commented Jan 28, 2026

Copy link
Copy Markdown

Summary

Add WithTruncate option to control whether prompts exceeding the context length are silently truncated (default) or return an error.

The Ollama API supports a truncate parameter for generate and chat endpoints, but it was not exposed in langchaingo.

PR Checklist

  • Read the Contributing documentation.
  • Read the Code of conduct documentation.
  • Name your Pull Request title clearly, concisely, and prefixed with the name of the primarily affected package you changed according to Good commit messages (such as memory: add interfaces for X, Y or util: add whizzbang helpers).
  • Check that there isn't already a PR that solves the problem the same way to avoid creating a duplicate.
  • Provide a description in this PR that addresses what the PR is solving, or reference the issue that it solves (e.g. Fixes #123).
  • Describes the source of new concepts.
  • References existing implementations as appropriate.
  • Contains test coverage for new functions.
  • Passes all golangci-lint checks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant