Skip to content

Add docvalue_fields support documentation for knn_vector fields#12471

Merged
kolchfa-aws merged 2 commits into
opensearch-project:mainfrom
navneet1v:main
May 29, 2026
Merged

Add docvalue_fields support documentation for knn_vector fields#12471
kolchfa-aws merged 2 commits into
opensearch-project:mainfrom
navneet1v:main

Conversation

@navneet1v
Copy link
Copy Markdown
Contributor

@navneet1v navneet1v commented May 27, 2026

Description

Add documentation for retrieving knn_vector fields using docvalue_fields,
introduced in OpenSearch 3.7. This feature reads vectors directly from
doc values instead of _source, providing up to 2x throughput improvement
for JSON transport. Supports binary (base64, default) and array formats
across all k-NN engines, data types, and compression levels with no
reindexing required.

  • Add "Retrieve vectors using doc values" section to performance tuning
  • Add "Retrieving vector fields using docvalue_fields" section to retrieve specific fields guide
  • Update search API and gRPC search API references with knn_vector format details

Issues Resolved

opensearch-project/k-NN#3315

Version

3.7 and above

Frontend features

If you're submitting documentation for an OpenSearch Dashboards feature, add a video that shows how a user will interact with the UI step by step. A voiceover is optional.

Checklist

  • By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and subject to the Developers Certificate of Origin.
    For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@github-actions github-actions Bot added the Tech review PR: Tech review in progress label May 27, 2026
@github-actions
Copy link
Copy Markdown

Thank you for submitting your PR. The PR states are In progress (or Draft) -> Tech review -> Doc review -> Merged.

Before you submit your PR for doc review, make sure the content is technically accurate. If you need help finding a tech reviewer, tag a maintainer.

When you're ready for doc review, tag the assignee of this PR. The doc reviewer may push edits to the PR directly or leave comments and editorial suggestions for you to address (let us know in a comment if you have a preference).

@navneet1v
Copy link
Copy Markdown
Contributor Author

@kolchfa-aws can you please review the PR.

Comment thread _api-reference/search-apis/search.md Outdated
Comment thread _search-plugins/searching-data/retrieve-specific-fields.md Outdated
Comment thread _search-plugins/searching-data/retrieve-specific-fields.md Outdated
Comment thread _vector-search/performance-tuning-search.md Outdated
@kolchfa-aws kolchfa-aws added the release-notes PR: Include this PR in the automated release notes label May 27, 2026
@kolchfa-aws
Copy link
Copy Markdown
Collaborator

@navneet1v Could you please address tech review comments first? I'll review after the tech review is finished. Thanks!

@navneet1v navneet1v force-pushed the main branch 2 times, most recently from 1465de8 to ca3df4f Compare May 27, 2026 22:47
@navneet1v
Copy link
Copy Markdown
Contributor Author

@vamshin resolved your comments. can you please review?

  Add documentation for retrieving knn_vector fields using docvalue_fields,
  introduced in OpenSearch 3.7. This feature reads vectors directly from
  doc values instead of _source, providing up to 2x throughput improvement
  for JSON transport. Supports binary (base64, default) and array formats
  across all k-NN engines, data types, and compression levels with no
  reindexing required.

  - Add "Retrieve vectors using doc values" section to performance tuning
  - Add "Retrieving vector fields using docvalue_fields" section to
    retrieve specific fields guide
  - Update search API and gRPC search API references with knn_vector
    format details

Signed-off-by: Navneet Verma <navneev@amazon.com>
Copy link
Copy Markdown
Member

@vamshin vamshin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks

@navneet1v
Copy link
Copy Markdown
Contributor Author

@kolchfa-aws can you please review now?

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Copy link
Copy Markdown
Collaborator

@kolchfa-aws kolchfa-aws left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you, @navneet1v! Doc review complete and changes applied.

@kolchfa-aws kolchfa-aws merged commit 6950e81 into opensearch-project:main May 29, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

release-notes PR: Include this PR in the automated release notes Tech review PR: Tech review in progress v3.7.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants