Support automatic plugin loading in Data Prepper core.#6882
Open
dlvenable wants to merge 1 commit into
Open
Conversation
dlvenable
requested review from
KarstenSchnitter,
Zhangxunmt,
dinujoh,
divbok,
graytaylor0,
kkondaka,
oeyh,
san81,
sb2k16,
srikanthjg and
srikanthpadakanti
as code owners
This change allows plugin authors to load other plugins by defining @UsesDataPrepperPlugin on a field with a different type. It will automatically load the plugin using the PluginFactory and give the main plugin the desired plugin instance that they are looking for. This updates the sqs source to use this new capability for its InputCodec defined by the codec property. Resolves opensearch-project#4838 Signed-off-by: David Venable <dlv@amazon.com>
dlvenable
force-pushed
the
4838-plugins-within-plugins
branch
from
525f096 to
163d99c
Compare
Davidding4718
approved these changes
May 22, 2026
Contributor
Davidding4718
left a comment
Davidding4718
left a comment
There was a problem hiding this comment.
LGTM! I think this will be helpful
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
This change allows plugin authors to load other plugins by defining
@UsesDataPrepperPluginon a field with a different type. It will automatically load the plugin using thePluginFactoryand give the main plugin the desired plugin instance that they are looking for.For backward compatibility, if the target type is
PluginModelthis will not attempt to load the plugin.The overall approach I took was to add custom deserialization in the Jackson
ObjectMapperto load the plugin.This updates the
sqssource to use this new capability for itsInputCodecdefined by the codec property.Issues Resolved
Resolves #4838
Check List
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.