added delete_source functionality to the dissect processor

[alamzeeshan]

Description

This change will add a new functionality to the dissect processor. Now users can choose a new option delete_source: true which will delete the source field if dissect processor was successful in extracting the fields.

Example config:

  processor:
    - dissect:
        map:
          message: "%{Date} %{Time} %{Log_Type}: %{Message}"
        delete_source: true

Issues Resolved

Resolves #5345

Check List

• [x ] New functionality includes testing.
• New functionality has a documentation issue. Please link to it in this PR.
  • [ x] New functionality has javadoc added
• [ x] Commits are signed with a real name per the DCO

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[dlvenable]

Thank you @alamzeeshan !

[san81]

Nice. Thanks for the contribution.

[dlvenable]

@alamzeeshan , Can you create a GitHub issue against the documentation-website with information for this?

[alamzeeshan]

@alamzeeshan , Can you create a GitHub issue against the documentation-website with information for this?

@dlvenable Created opensearch-project/documentation-website#9951

[dlvenable]

@alamzeeshan ,

I see this failure:

> Task :data-prepper-plugins:dissect-processor:checkstyleMain
/home/runner/work/data-prepper/data-prepper/data-prepper-plugins/dissect-processor/src/test/java/org/opensearch/dataprepper/plugins/processor/dissect/DissectProcessorTest.java:288: error: cannot find symbol
        assertFalse(dissectedRecords.get(0).getData().containsKey("test"));
        ^
  symbol:   method assertFalse(boolean)
  location: class DissectProcessorTest
1 error

> Task :data-prepper-plugins:dissect-processor:compileTestJava FAILED

You can run the unit tests for this project to fast check on your side:

./gradlew -p data-prepper-plugins/dissect-processor clean build

[alamzeeshan]

@alamzeeshan ,

I see this failure:

> Task :data-prepper-plugins:dissect-processor:checkstyleMain
/home/runner/work/data-prepper/data-prepper/data-prepper-plugins/dissect-processor/src/test/java/org/opensearch/dataprepper/plugins/processor/dissect/DissectProcessorTest.java:288: error: cannot find symbol
        assertFalse(dissectedRecords.get(0).getData().containsKey("test"));
        ^
  symbol:   method assertFalse(boolean)
  location: class DissectProcessorTest
1 error

> Task :data-prepper-plugins:dissect-processor:compileTestJava FAILED

You can run the unit tests for this project to fast check on your side:

./gradlew -p data-prepper-plugins/dissect-processor clean build

Hi @dlvenable ,

I missed one import statement. I have update the code and verified the build using ./gradlew -p data-prepper-plugins/dissect-processor clean build. BUILD WAS SUCCESSFUL. Please take a look

[alamzeeshan]

Nice. Thanks for the contribution.

Hi @san81 , Can you please re-approve this PR. I added a missing import statement.

[alamzeeshan]

Hi @san81 @kkondaka Can you please review this PR?

[san81]

Thank you for this nice contribution