Skip to content

data-prepper.change-log-2.2.0.md

Latest commit

 

History

History
1125 lines (657 loc) · 39.8 KB

data-prepper.change-log-2.2.0.md

File metadata and controls

1125 lines (657 loc) · 39.8 KB

  • Updated plugin names for otel plugins (#2526)

    Asif Sohail Mohammed - Thu, 20 Apr 2023 10:54:43 -0500

    EAD -> refs/heads/2.2-change-log, refs/remotes/upstream/main, refs/remotes/origin/main, refs/remotes/origin/HEAD, refs/heads/main

    • Updated plugin names for otel plugins Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

  • Update dependency versions to fix CVEs (#2546)

    Hai Yan - Thu, 20 Apr 2023 09:45:59 -0500

    • Update dependency versions to fix CVEs Signed-off-by: Hai Yan <oeyh@amazon.com>

  • Opensearch serverless change (#2542)

    Asif Sohail Mohammed - Thu, 20 Apr 2023 09:28:52 -0500

  • Fix STS logging (#2552)

    Asif Sohail Mohammed - Thu, 20 Apr 2023 09:25:41 -0500

    Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

  • Add Metrics to end-to-end acknowledgement core framework (#2506)

    kkondaka - Wed, 19 Apr 2023 23:33:39 -0500

    • Add Metrics to end-to-end acknowledgement core framework Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

  • Added routes as an alias to route (#2535)

    Asif Sohail Mohammed - Wed, 19 Apr 2023 21:00:57 -0500

    Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

  • Start directory for built-in grok patterns for the grok processor, as well as some common patterns (#2514)

    Taylor Gray - Wed, 19 Apr 2023 19:22:27 -0500

    Signed-off-by: Taylor Gray <tylgry@amazon.com>

  • Adds branching on supported configurations for ScanRange (#2539)

    Chase - Wed, 19 Apr 2023 18:26:19 -0500

    Signed-off-by: Chase Engelbrecht <engechas@amazon.com>

  • Bump io.micrometer:micrometer-bom from 1.9.4 to 1.10.5 (#2433)

    dependabot[bot] - Wed, 19 Apr 2023 17:13:07 -0500

    Bumps io.micrometer:micrometer-bom from 1.9.4 to 1.10.5.

    Commits

    updated-dependencies:

    • dependency-name: io.micrometer:micrometer-bom dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Updated package name for otel logs source (#2518)

    Asif Sohail Mohammed - Wed, 19 Apr 2023 16:59:21 -0500

    • Updated package name for otel logs source Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

  • Add documentation for list_to_map processor (#2474)

    Hai Yan - Wed, 19 Apr 2023 16:14:45 -0500

    • Add docs for list_to_map processor Signed-off-by: Hai Yan <oeyh@amazon.com>

    Signed-off-by: Hai Yan <oeyh@amazon.com>

  • Shutdown Data Prepper when any pipeline fails by default, but allow configuration so that only it can remain running as long as one pipeline is still running. #2441 (#2524)

    David Venable - Wed, 19 Apr 2023 15:44:31 -0500

    Signed-off-by: David Venable <dlv@amazon.com>

  • Document acknowledgements option to s3 source (#2530)

    kkondaka - Wed, 19 Apr 2023 13:55:49 -0500

    Modified to use only one spelling - acknowledgment Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

    Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

  • address build failure in 2511 (#2534)

    Christopher Manning - Wed, 19 Apr 2023 12:42:46 -0500

    Signed-off-by: Christopher Manning <cmanning09@users.noreply.github.com>

  • addressing metrics publishing bug for DLQ (#2523)

    Christopher Manning - Wed, 19 Apr 2023 12:05:47 -0500

    Signed-off-by: Christopher Manning <cmanning09@users.noreply.github.com>

  • [2511] adding support for document_root_key (#2516)

    Christopher Manning - Wed, 19 Apr 2023 11:02:48 -0500

  • adding wrapper dlq object, dlq file xtensions and improving dlq README (#2509)

    Christopher Manning - Wed, 19 Apr 2023 10:24:35 -0500

    Signed-off-by: Christopher Manning <cmanning09@users.noreply.github.com>

  • Shut down Data Prepper after all pipelines have shutdown. Also close the Application Context so that it can close other dependencies. #2441 (#2495)

    David Venable - Tue, 18 Apr 2023 17:04:24 -0500

    Signed-off-by: David Venable <dlv@amazon.com>

  • -Support for Source Codecs (#2519)

    umayr-codes - Tue, 18 Apr 2023 12:02:01 -0500

    -Support for Source Codecs Signed-off-by: umairofficial <umairhusain1010@gmail.com>

    Co-authored-by: umairofficial <umairhusain1010@gmail.com>

  • Generated THIRD-PARTY file for bc75494 (#2517)

    opensearch-trigger-bot[bot] - Tue, 18 Apr 2023 09:28:46 -0500

    Signed-off-by: GitHub <noreply@github.com> Co-authored-by: asifsmohammed <asifsmohammed@users.noreply.github.com>

  • Change the behavior of the CSV codec in the S3 source to fail when it is unable to parse CSV rows. Resolves #2512. (#2513)

    David Venable - Mon, 17 Apr 2023 21:10:26 -0500

    Signed-off-by: David Venable <dlv@amazon.com>

  • Allow deprecated plugin names (#2508)

    Asif Sohail Mohammed - Mon, 17 Apr 2023 21:10:05 -0500

    Allow deprecated plugin names and update otel plugin names Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

    Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

  • removing event handle from dlq object (#2510)

    Christopher Manning - Mon, 17 Apr 2023 17:59:24 -0500

    Signed-off-by: Christopher Manning <cmanning09@users.noreply.github.com>

  • end_to_end_acknowledgements option name change (#2486)

    kkondaka - Mon, 17 Apr 2023 15:51:31 -0500

    Rename end_to_end_acknowledgements to acknowledgements and support alias acknowledgments Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

    Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

  • Update RCF maven repository to latest (#2507)

    kkondaka - Mon, 17 Apr 2023 14:26:12 -0500

    Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

  • FileSink updates: Remove call to initialize(), adds FileSinkConfig, test updates (#2475)

    David Venable - Mon, 17 Apr 2023 09:42:12 -0500

    Removes an unnecessary call to initialize() in the FileSink constructor. Updates FileSink to use a FileSinkConfig. Updates FileSink tests. Signed-off-by: David Venable <dlv@amazon.com>

    Signed-off-by: David Venable <dlv@amazon.com>

  • Properly shutdown the log_generator plugin correctly. It was preventing Data Prepper from shutting down. (#2494)

    David Venable - Fri, 14 Apr 2023 13:25:36 -0500

    Signed-off-by: David Venable <dlv@amazon.com>

  • Adding iam role arn validation to s3 source and open search sink configs (#2472)

    roshan-dongre - Fri, 14 Apr 2023 09:49:57 -0500

    • adding iam role arn validation to s3 source and open search sink configs Signed-off-by: Roshan Dongre <roshdngr@amazon.com>

  • Move backoff strategy to BufferAccumulator (#2481)

    Chase - Thu, 13 Apr 2023 20:21:51 -0500

    Signed-off-by: Chase Engelbrecht <engechas@amazon.com>

  • Fix warning message when Open Search Sink fails to initialize (#2482)

    kkondaka - Thu, 13 Apr 2023 17:11:11 -0500

    Fix warning message when Open Search Sink fails to initialize Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

    Signed-off-by: Krishna Kondaka <krishkdk@amazon.com> Co-authored-by: Krishna Kondaka <krishkdk@amazon.com>

  • Fixes an issue with the end-to-end acknowledgements where the the scheduled monitor thread holds a user thread and prevents Data Prepper from shutting down correctly. The monitor now runs in a dedicated daemon thread and the callback methods are submitted to a distinct executor service with a lower bound of available threads. Includes various test improvements as well. (#2483)

    David Venable - Thu, 13 Apr 2023 15:23:47 -0500

    Signed-off-by: David Venable <dlv@amazon.com>

  • Add End to End acknowledgement support for S3 source (#2465)

    kkondaka - Wed, 12 Apr 2023 18:30:13 -0500

    Add End to End acknowledgement support for S3 source Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

  • Fix cannot start databaseService.py with Trace Analytics Sample App (#2477) (#2478)

    Toby Lam - Wed, 12 Apr 2023 18:26:05 -0500

    Signed-off-by: Toby Lam <me@livekn.com>

  • OpenSearchSink: add support for sending end-to-end acknowledgements (#2458)

    kkondaka - Wed, 12 Apr 2023 16:33:59 -0500

    OpenSearchSink: add support for sending end-to-end acknowledgements Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

    Signed-off-by: Krishna Kondaka <krishkdk@amazon.com> Co-authored-by: Krishna Kondaka <krishkdk@amazon.com>

  • ENH: batching metrics with same tags in EMFLoggingMeterRegistry (#2467)

    Qi Chen - Wed, 12 Apr 2023 15:32:01 -0500

    Signed-off-by: George Chen <qchea@amazon.com>

  • Add format string option to add_entries processor (#2464)

    Hai Yan - Wed, 12 Apr 2023 14:08:13 -0500

    • Add format string option to add_entries processor
    • Update config validations
    • Update README Signed-off-by: Hai Yan <oeyh@amazon.com>

    Signed-off-by: Hai Yan <oeyh@amazon.com>

  • Fix: CVE-2023-20861 (#2473)

    Asif Sohail Mohammed - Tue, 11 Apr 2023 18:37:35 -0500

    Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

  • Retry flushing of buffer on buffer TimeoutException (#2470)

    Taylor Gray - Tue, 11 Apr 2023 14:24:44 -0500

    Retry flushing of buffer on buffer TimeoutException Signed-off-by: Taylor Gray <tylgry@amazon.com>

  • Address review comments from PR 2436 (#2459)

    kkondaka - Tue, 11 Apr 2023 12:11:09 -0500

    Address review comments from PR 2436 Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

    Signed-off-by: Krishna Kondaka <krishkdk@amazon.com> Co-authored-by: Krishna Kondaka <krishkdk@amazon.com>

  • Added integration tests for end-to-end acknowledgements (#2442)

    kkondaka - Mon, 10 Apr 2023 08:06:34 -0500

    Signed-off-by: Krishna Kondaka <krishkdk@amazon.com> Co-authored-by: Krishna Kondaka <krishkdk@amazon.com>

  • Add list_to_map processor (#2453)

    Hai Yan - Fri, 7 Apr 2023 11:56:03 -0500

    efs/heads/s3-records-metrics

    • Add list_to_map processor plugin Signed-off-by: Hai Yan <oeyh@amazon.com>

  • Add support for acknowledgements to source, process worker and router strategy (#2436)

    kkondaka - Thu, 6 Apr 2023 16:24:42 -0500

    Add support for acknowledgements to source, process worker and router strategy Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

    Signed-off-by: Krishna Kondaka <krishkdk@amazon.com> Co-authored-by: Krishna Kondaka <krishkdk@amazon.com>

  • Support running tests on OpenSearch 2.6.0 (#2455)

    David Venable - Thu, 6 Apr 2023 15:22:35 -0500

    Fixes an issue with the tests that prevented them from running against OpenSearch 2.6.0. This also tries to get ahead of other possible new system indexes. Adds more OpenSearch versions to the list of versions to test. Signed-off-by: David Venable <dlv@amazon.com>

    Signed-off-by: David Venable <dlv@amazon.com>

  • S3 select dev (#2447)

    Uday Chintala - Thu, 6 Apr 2023 14:04:44 -0500

    Incorporated new yaml changes for s3 select #1971 Signed-off-by: Uday Kumar Chintala <udaych20@gmail.com>

  • Updated S3 worker logging (#2438)

    Asif Sohail Mohammed - Wed, 5 Apr 2023 16:39:34 -0500

  • adding data-time patterns to key-path-prefix and creating readme for s3 dlq (#2451)

    Christopher Manning - Wed, 5 Apr 2023 16:28:58 -0500

    Signed-off-by: Christopher Manning <cmanning09@users.noreply.github.com>

  • Fix imports for AppendAggregateAction (#2452)

    Taylor Gray - Wed, 5 Apr 2023 12:55:05 -0500

    Signed-off-by: Taylor Gray <tylgry@amazon.com>

  • Count SQS message delete failures in the S3 source (#2450)

    David Venable - Wed, 5 Apr 2023 12:29:51 -0500

    Provide a new metric for when the S3 source is unable to delete an SQS message. Resolves #2449 Signed-off-by: David Venable <dlv@amazon.com>

    Signed-off-by: David Venable <dlv@amazon.com>

  • merge aggregation (#2230)

    Krishnanand Singh - Wed, 5 Apr 2023 10:32:51 -0500

    Add new aggregate action to create aggregated Event by appending values over time Signed-off-by: KrishnanandSingh <krishnanand_singh@cargill.com>

    Signed-off-by: Krishnanand Singh <krishnanand91@gmail.com>

  • adding support for dlq plugins in opensearch (#2429)

    Christopher Manning - Wed, 5 Apr 2023 09:28:32 -0500

    Signed-off-by: Christopher Manning <cmanning09@users.noreply.github.com>

  • Refactor source coordination to split interfaces between SourceCoordinator and SourceCoordinationStore (#2444)

    Taylor Gray - Wed, 5 Apr 2023 09:24:33 -0500

    Refactor source coordination to split interfaces between SourceCoordinator and SourceCoordinationStore Signed-off-by: Taylor Gray <tylgry@amazon.com>

  • Logging improvements to the csv codec, role arn, and span messages (#2448)

    roshan-dongre - Wed, 5 Apr 2023 08:26:47 -0500

    • Logging improvements to the csv codec, role arn, and span messages Signed-off-by: Roshan Dongre <roshdngr@amazon.com>

    • improving the log messaging of the otel trace raw processor Signed-off-by: Roshan Dongre <roshdngr@amazon.com>

    Signed-off-by: Roshan Dongre <roshdngr@amazon.com>

  • implementing s3 dlq writer (#2419)

    Christopher Manning - Tue, 4 Apr 2023 09:32:18 -0500

    • implementing s3 dlq writer

    Signed-off-by: Christopher Manning <cmanning09@users.noreply.github.com>

  • Addresses S3 Select YAML code review suggestions (#2439)

    Chase - Mon, 3 Apr 2023 11:35:32 -0500

    • Rebased. Fixed test cases and addressed review comments (#2399) Signed-off-by: Krishna Kondaka <krishkdk@amazon.com> Co-authored-by: Krishna Kondaka <krishkdk@amazon.com> Support for Snappy PR# 2420 (#2421) Snappy Support for PR# 2420 Signed-off-by: Ashok Telukuntla <ashoktla@amazon.com> MAINT: replace grok debugger (#2425) Signed-off-by: George Chen <qchea@amazon.com> Wire in source_coordination config and SourceCoordinator interface to Source plugins (#2395) Wire in source_coordination config and SourceCoordinator inteface to Source plugins Signed-off-by: Taylor Gray <tylgry@amazon.com> Add EventFactory and AcknowledgementSetManager instantiations and make them available (#2426) Add EventFactory and AcknowledgementSetManager instantiations and make them available Signed-off-by: Krishna Kondaka <krishkdk@amazon.com> Updated SQS logging (#2417) Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com> Address code review comment of changing yaml parameters to expression, input_serialization PR#1971 Signed-off-by: Ashok Telukuntla <ashoktla@amazon.com> Snappy Support for PR# 2420 Signed-off-by: Ashok Telukuntla <ashoktla@amazon.com> Snappy Support for PR# 2420 Signed-off-by: Ashok Telukuntla <ashoktla@amazon.com> Snappy Support for PR# 2420 Signed-off-by: Ashok Telukuntla <ashoktla@amazon.com> Snappy Support for PR# 2420 Signed-off-by: Ashok Telukuntla <ashoktla@amazon.com> Snappy Support for PR# 2420 Signed-off-by: Ashok Telukuntla <ashoktla@amazon.com> Fix test broken by rename Signed-off-by: Chase Engelbrecht <engechas@amazon.com>

    • Fix spacing Signed-off-by: Chase Engelbrecht <engechas@amazon.com>

    Signed-off-by: Chase Engelbrecht <engechas@amazon.com> Co-authored-by: kkondaka <41027584+kkondaka@users.noreply.github.com>

  • Updated SQS logging (#2417)

    Asif Sohail Mohammed - Sat, 1 Apr 2023 22:20:08 -0500

    Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

  • Add EventFactory and AcknowledgementSetManager instantiations and make them available (#2426)

    kkondaka - Fri, 31 Mar 2023 15:04:33 -0500

    Add EventFactory and AcknowledgementSetManager instantiations and make them available Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

  • Wire in source_coordination config and SourceCoordinator interface to Source plugins (#2395)

    Taylor Gray - Fri, 31 Mar 2023 12:45:43 -0500

    Wire in source_coordination config and SourceCoordinator inteface to Source plugins Signed-off-by: Taylor Gray <tylgry@amazon.com>

  • MAINT: replace grok debugger (#2425)

    Qi Chen - Thu, 30 Mar 2023 23:24:39 -0500

    Signed-off-by: George Chen <qchea@amazon.com>

  • Support for Snappy PR# 2420 (#2421)

    Ashok Telukuntla - Thu, 30 Mar 2023 16:13:54 -0500

    Snappy Support for PR# 2420 Signed-off-by: Ashok Telukuntla <ashoktla@amazon.com>

  • Rebased. Fixed test cases and addressed review comments (#2399)

    kkondaka - Thu, 30 Mar 2023 15:05:35 -0500

    Signed-off-by: Krishna Kondaka <krishkdk@amazon.com> Co-authored-by: Krishna Kondaka <krishkdk@amazon.com>

  • S3 select dev (#2353)

    Uday Chintala - Thu, 30 Mar 2023 09:44:20 -0500

    • Support S3 Select when loading objects from S3 via the S3 source #1971 Signed-off-by: Uday Kumar Chintala <udaych20@gmail.com>

    • Support S3 Select when loading objects from S3 via the S3 source #1971 Signed-off-by: Uday Kumar Chintala <udaych20@gmail.com>

    • Incorporated review comments for Issue #1971 Signed-off-by: Uday Kumar Chintala <udaych20@gmail.com>

    • Indentation issue fix. Signed-off-by: Uday Kumar Chintala <udaych20@gmail.com>

    • EventMetadataModifier used in S3 Select, Review Comment Changes Signed-off-by: Uday Kumar Chintala <udaych20@gmail.com>

    • Modified S3 Select Readme.md file Signed-off-by: Uday Kumar Chintala <udaych20@gmail.com>

    • Incorporated S3 Select review changes #1971 Signed-off-by: Uday Kumar Chintala <udaych20@gmail.com>

    • Removed as this is related to s3 select integration tests Signed-off-by: Uday Kumar Chintala <udaych20@gmail.com>

    • Incorporated review comments for Issue#1971 Signed-off-by: Uday Kumar Chintala <udaych20@gmail.com>

    Signed-off-by: Uday Kumar Chintala <udaych20@gmail.com>

  • updating opensearch sink constructor to support loading dlq plugins (#2415)

    Christopher Manning - Wed, 29 Mar 2023 14:57:14 -0500

    Signed-off-by: Christopher Manning <cmanning09@users.noreply.github.com>

  • adding dlqObject and dlqWriter interface to (#2392)

    Christopher Manning - Wed, 29 Mar 2023 14:56:42 -0500

    Signed-off-by: Christopher Manning <cmanning09@users.noreply.github.com>

  • Add acknowledgementSet and acknowledgementSetManager - End-to-End Ack Support (#2394)

    kkondaka - Wed, 29 Mar 2023 12:31:50 -0500

    Signed-off-by: Krishna Kondaka <krishkdk@amazon.com> Co-authored-by: Krishna Kondaka <krishkdk@amazon.com>

  • ENH: opensearch sink AOSS support (#2385)

    Qi Chen - Tue, 28 Mar 2023 09:14:18 -0500

    Signed-off-by: George Chen <qchea@amazon.com>

  • Updated the Developer Guide to point users to the Data Prepper documentation on opensearch.org. (#2367)

    David Venable - Tue, 28 Mar 2023 09:04:13 -0500

    Signed-off-by: David Venable <dlv@amazon.com>

  • Bump commons-io:commons-io in /data-prepper-plugins/otel-metrics-source (#2336)

    dependabot[bot] - Mon, 27 Mar 2023 16:35:35 -0500

    Bumps commons-io:commons-io from 2.10.0 to 2.11.0.

    updated-dependencies:

    • dependency-name: commons-io:commons-io dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump net.bytebuddy:byte-buddy in /data-prepper-plugins/opensearch (#2407)

    dependabot[bot] - Mon, 27 Mar 2023 13:49:01 -0500

    Bumps net.bytebuddy:byte-buddy from 1.12.22 to 1.14.2.

    Commits

    updated-dependencies:

    • dependency-name: net.bytebuddy:byte-buddy dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump commons-io:commons-io in /data-prepper-plugins/otel-trace-source (#2335)

    dependabot[bot] - Mon, 27 Mar 2023 13:45:58 -0500

    Bumps commons-io:commons-io from 2.10.0 to 2.11.0.

    updated-dependencies:

    • dependency-name: commons-io:commons-io dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump org.apache.logging.log4j:log4j-bom in /data-prepper-expression (#2334)

    dependabot[bot] - Mon, 27 Mar 2023 13:45:02 -0500

    Bumps org.apache.logging.log4j:log4j-bom from 2.19.0 to 2.20.0.

    updated-dependencies:

    • dependency-name: org.apache.logging.log4j:log4j-bom dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Use Gradle version cataglos for Slf4j, Spring, Hamcrest, and Awaitility. Finished some missing JUnit dependencies. Removed some uses of Hamcrest and Awaitility which were not needed since these are part of the root project. (#2382)

    David Venable - Mon, 27 Mar 2023 12:30:28 -0500

    Signed-off-by: David Venable <dlv@amazon.com>

  • Fixing java doc warnings (#2396)

    kkondaka - Thu, 23 Mar 2023 12:49:41 -0500

    efs/heads/s3-metadata-config Signed-off-by: Krishna Kondaka <krishkdk@amazon.com> Co-authored-by: Krishna Kondaka <krishkdk@amazon.com>

  • improving logging in OSDP (#2391)

    roshan-dongre - Tue, 21 Mar 2023 15:31:24 -0500

    Signed-off-by: Roshan Dongre <roshdngr@amazon.com>

  • Add Event Factory and generic event builder infrastructure (#2378)

    kkondaka - Mon, 20 Mar 2023 19:13:31 -0500

    Add Event Factory and generic event builder infrastructure Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

    Signed-off-by: Krishna Kondaka <krishkdk@amazon.com> Co-authored-by: Krishna Kondaka <krishkdk@amazon.com>

  • FIX: isolated service node (#2384)

    Qi Chen - Mon, 20 Mar 2023 14:22:52 -0500

    • FIX: service-map isolated service Signed-off-by: George Chen <qchea@amazon.com>

  • Remove the old peer-forwarder build.gradle file. It is not part of the build and just needs to be deleted. (#2386)

    David Venable - Mon, 20 Mar 2023 14:20:49 -0500

    Signed-off-by: David Venable <dlv@amazon.com>

  • Updated the Java serialization allowlist to have specific classes for JsonNode. Added new tests to verify that this new allowlist does not interfere with some expected Event patterns. (#2376)

    David Venable - Fri, 17 Mar 2023 15:18:11 -0500

    Signed-off-by: David Venable <dlv@amazon.com>

  • OpenSearch Sink should make the number of retries configurable - Issue #2291 (#2339)

    kkondaka - Thu, 16 Mar 2023 16:54:20 -0500

    OpenSearch Sink should make the number of retries configurable - Issue #2291

    Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

    Signed-off-by: Krishna Kondaka <krishkdk@amazon.com> Co-authored-by: Krishna Kondaka <krishkdk@amazon.com>

  • Added change log for 2.1.1 (#2377)

    Asif Sohail Mohammed - Thu, 16 Mar 2023 11:27:35 -0500

    efs/heads/snakeyaml-2.0 Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

  • Added release notes for 2.1.1 (#2375)

    Asif Sohail Mohammed - Thu, 16 Mar 2023 11:27:19 -0500

    Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

  • Use Netty version supplied by dependencies (#2031)

    David Venable - Mon, 13 Mar 2023 16:21:11 -0500

    efs/heads/2.1.1-release-notes

    • Removed old constraints on Netty which were resulting in pulling in older version of Netty. Our dependencies (Armeria and AWS SDK Java client) are pulling in newer versions so these old configurations are not necessary anymore. Signed-off-by: David Venable <dlv@amazon.com>

  • Fix: Fixed IllegalArgumentException in PluginMetrics (#2369)

    Asif Sohail Mohammed - Thu, 9 Mar 2023 12:54:31 -0600

    • Fix: Fixed IllegalArgumentException in PluginMetrics caused by pipeline name Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

  • FIX: traceState not required in Link (#2363)

    Qi Chen - Fri, 3 Mar 2023 16:55:37 -0600

    Signed-off-by: George Chen <qchea@amazon.com>

  • Added 2.1 change log (#2360)

    Asif Sohail Mohammed - Thu, 2 Mar 2023 15:20:55 -0600

    Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

  • Add release notes for 2.1.0 (#2354)

    Hai Yan - Thu, 2 Mar 2023 13:52:16 -0600

  • Added backoff for SQS to reduce logging (#2326)

    Asif Sohail Mohammed - Thu, 2 Mar 2023 12:14:20 -0600

  • Removed default service endpoint for otel sources (#2346)

    Asif Sohail Mohammed - Thu, 2 Mar 2023 11:38:54 -0600

    • Removed default service endpoint for otel sources Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

  • Replace the java.util.* allowed pattern in the ObjectInputFilter with specific classes which are commonly used in Data Prepper. (#2351)

    David Venable - Thu, 2 Mar 2023 09:53:00 -0600

    Signed-off-by: David Venable <dlv@amazon.com>

  • Explicitly set the GitHub Actions thumbprint to resolve #2343. Updated the AWS CDK as well. (#2345)

    David Venable - Wed, 1 Mar 2023 15:40:05 -0600

    Signed-off-by: David Venable <dlv@amazon.com>

  • Updated version to 2.2 on main (#2342)

    Asif Sohail Mohammed - Wed, 1 Mar 2023 13:27:15 -0600

    Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

  • Generated THIRD-PARTY file for 062ae95 (#2344)

    opensearch-trigger-bot[bot] - Wed, 1 Mar 2023 13:26:20 -0600

    Signed-off-by: GitHub <noreply@github.com> Co-authored-by: asifsmohammed <asifsmohammed@users.noreply.github.com>

  • Use an ObjectInputFilter to serialize allow deserialization of only certain objects in peer-to-peer connections. Additionally, it refactors some application configurations to improve integration testing. Fixes #2310. (#2311)

    David Venable - Wed, 1 Mar 2023 10:06:52 -0600

    efs/heads/changelog-2.1 Signed-off-by: David Venable <dlv@amazon.com>

  • Bump org.apache.logging.log4j:log4j-bom in /data-prepper-core (#2333)

    dependabot[bot] - Wed, 1 Mar 2023 09:47:42 -0600

    Bumps org.apache.logging.log4j:log4j-bom from 2.19.0 to 2.20.0.

    updated-dependencies:

    • dependency-name: org.apache.logging.log4j:log4j-bom dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump org.assertj:assertj-core from 3.21.0 to 3.24.2 (#2331)

    dependabot[bot] - Wed, 1 Mar 2023 09:47:06 -0600

    Bumps org.assertj:assertj-core from 3.21.0 to 3.24.2.

    updated-dependencies:

    • dependency-name: org.assertj:assertj-core dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump org.junit.jupiter:junit-jupiter-api from 5.9.0 to 5.9.2 (#2332)

    dependabot[bot] - Wed, 1 Mar 2023 09:46:26 -0600

    Bumps org.junit.jupiter:junit-jupiter-api from 5.9.0 to 5.9.2.

    updated-dependencies:

    • dependency-name: org.junit.jupiter:junit-jupiter-api dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Support for path in OTel sources (#2297)

    Asif Sohail Mohammed - Tue, 28 Feb 2023 19:57:38 -0600

    Initial commit for OTel trace path changes Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com> Signed-off-by: Asif Sohail Mohammed <mdasifsohail7@gmail.com>

  • Fix grok processor to not create a new record (#2325)

    kkondaka - Tue, 28 Feb 2023 19:56:04 -0600

    Signed-off-by: Krishna Kondaka <krishkdk@amazon.com> Co-authored-by: Krishna Kondaka <krishkdk@amazon.com>

  • Bump org.springframework:spring-context in /data-prepper-expression (#2223)

    dependabot[bot] - Mon, 27 Feb 2023 18:27:04 -0600

    efs/heads/otel-paths Bumps org.springframework:spring-context from 5.3.23 to 5.3.25.

    Commits

    updated-dependencies:

    • dependency-name: org.springframework:spring-context dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump org.springframework:spring-context in /data-prepper-core (#2214)

    dependabot[bot] - Mon, 27 Feb 2023 16:52:20 -0600

    Bumps org.springframework:spring-context from 5.3.23 to 5.3.25.

    Commits

    updated-dependencies:

    • dependency-name: org.springframework:spring-context dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump io.spring.dependency-management from 1.0.11.RELEASE to 1.1.0 (#2106)

    dependabot[bot] - Mon, 27 Feb 2023 16:48:25 -0600

    Bumps io.spring.dependency-management from 1.0.11.RELEASE to 1.1.0.

    updated-dependencies:

    • dependency-name: io.spring.dependency-management dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump com.fasterxml.jackson.datatype:jackson-datatype-jdk8 (#2217)

    dependabot[bot] - Mon, 27 Feb 2023 16:47:36 -0600

    Bumps com.fasterxml.jackson.datatype:jackson-datatype-jdk8 from 2.14.1 to 2.14.2.

    updated-dependencies:

    • dependency-name: com.fasterxml.jackson.datatype:jackson-datatype-jdk8 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Added path support for HTTP source (#2277)

    Asif Sohail Mohammed - Mon, 27 Feb 2023 15:26:58 -0600

    • Added path support for HTTP source Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

  • Updated Data Prepper base image for e2e tests (#2269)

    Asif Sohail Mohammed - Mon, 27 Feb 2023 15:08:13 -0600

    Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>