Skip to content

Release notes for Data Prepper 2.11 #5633

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
kkondaka merged 2 commits into from
Apr 27, 2025
Merged

Release notes for Data Prepper 2.11 #5633

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
b1c64eb
Release notes for Data Prepper 2.11
dlvenable Apr 21, 2025
78013c5
Adds missing issue/PR as pointed out in PR for release notes.
dlvenable Apr 23, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
54 changes: 54 additions & 0 deletions release/release-notes/data-prepper.release-notes-2.11.0.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,54 @@
## 2025-04-24 Version 2.11.0

---

### Features

* Support AWS Aurora/RDS PostgreSQL as source ([#5309](https://github.com/opensearch-project/data-prepper/issues/5309))
* Support SQS as a Source ([#1049](https://github.com/opensearch-project/data-prepper/issues/1049))
* Jira Connector - to seamlessly sync all the ticket details to OpenSearch ([#4754](https://github.com/opensearch-project/data-prepper/issues/4754))
* AWS Lambda as Processor and Sink ([#4699](https://github.com/opensearch-project/data-prepper/issues/4699))
* Support AWS Aurora/RDS MySQL as source ([#4561](https://github.com/opensearch-project/data-prepper/issues/4561))
* AWS Lambda as Sink ([#4170](https://github.com/opensearch-project/data-prepper/issues/4170))
* Integrate OpenSearch Ml-Commons into Data Prepper ([#5509](https://github.com/opensearch-project/data-prepper/issues/5509))

### Enhancements

* Update OTel Protobuf specification ([#5434](https://github.com/opensearch-project/data-prepper/pull/5434))
* Data Prepper support for dynamic renaming of keys ([#4849](https://github.com/opensearch-project/data-prepper/issues/4849))
* S3 DLQ should pass expected bucket owner to PutObject request ([#5498](https://github.com/opensearch-project/data-prepper/issues/5498))
* AWS Secrets Manager Plugin does not support sts_header_overrides ([#5475](https://github.com/opensearch-project/data-prepper/issues/5475))
* Support configurable stream read constraints max length in the JSON input codec ([#5466](https://github.com/opensearch-project/data-prepper/issues/5466))
* Support reading S3 object metadata only ([#5433](https://github.com/opensearch-project/data-prepper/issues/5433))
* Kafka local AWS Glue registry support ([#5377](https://github.com/opensearch-project/data-prepper/issues/5377))
* Address Scale Items for Lambda Processor and Sink ([#5031](https://github.com/opensearch-project/data-prepper/issues/5031))
* Add support to skip remote peer forwarding based on configuration ([#5127](https://github.com/opensearch-project/data-prepper/pull/5127))
* Add index_types for OTel logs and metrics #3148 ([#3929](https://github.com/opensearch-project/data-prepper/pull/3929))
* Send RetryInfo on OTel timeouts to improve or clarify backpressure on OTel gRPC sources ([#4294](https://github.com/opensearch-project/data-prepper/pull/4294), [#4119](https://github.com/opensearch-project/data-prepper/issues/4119))
* Enhance Lambda processor to retry based on certain class of exception ([#5340](https://github.com/opensearch-project/data-prepper/issues/5340))
* Support multiple delete_when condition in delete_entries processor ([#5315](https://github.com/opensearch-project/data-prepper/issues/5315))
* Add additional index_types ([#3148](https://github.com/opensearch-project/data-prepper/issues/3148))
* Add experimental feature concept ([#2695](https://github.com/opensearch-project/data-prepper/issues/2695))

### Bug Fixes

* NullPointerException on S3 Delete Event Due to Null Object Size ([#5448](https://github.com/opensearch-project/data-prepper/issues/5448))
* Index Template with flat_object type field fails during deserialization ([#5425](https://github.com/opensearch-project/data-prepper/issues/5425))
* DynamoDB source with acknowledgements expires frequently ([#5412](https://github.com/opensearch-project/data-prepper/issues/5412))
* Kinesis source doesn't pass the given polling retrieval config to underlying KCL ([#5269](https://github.com/opensearch-project/data-prepper/issues/5269))
* UTF-8 Character Encoding Issues in opensearchproject/data-prepper container ([#5238](https://github.com/opensearch-project/data-prepper/issues/5238))
* Validate that routes configured in the sink exist on startup of Data Prepper ([#5106](https://github.com/opensearch-project/data-prepper/issues/5106))
* Escaping of "/" in json pointers ([#5101](https://github.com/opensearch-project/data-prepper/issues/5101))
* DynamoDB Source doesn't support parsing data with Control Characters ([#5027](https://github.com/opensearch-project/data-prepper/issues/5027))

### Security

* [docker] Run as non root ([#5311](https://github.com/opensearch-project/data-prepper/issues/5311))
* werkzeug-3.0.3-py3-none-any.whl: 2 vulnerabilities (highest severity is: 7.5) ([#5122](https://github.com/opensearch-project/data-prepper/issues/5122))

### Maintenance

* Migrate existing plugins to use POJO configuration classes. ([#5246](https://github.com/opensearch-project/data-prepper/issues/5246))
* Support examples in documentation ([#5077](https://github.com/opensearch-project/data-prepper/issues/5077))
* End-to-end log test failing when index name has DateTime pattern suffix in OpenSearch Sink Config ([#984](https://github.com/opensearch-project/data-prepper/issues/984))

Loading