Skip to content

Commit 47846ef

Browse files
committed
Revert "Introduce checkpointing per shard to DDB source, via ShardAcknowledgementManager class (opensearch-project#5818)"
This reverts commit dfc3c70. Signed-off-by: Taylor Gray <tylgry@amazon.com>
1 parent 5a3df3d commit 47846ef

12 files changed

Lines changed: 320 additions & 745 deletions

File tree

data-prepper-plugins/dynamodb-source/build.gradle

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -23,9 +23,7 @@ dependencies {
2323

2424
implementation project(path: ':data-prepper-plugins:aws-plugin-api')
2525
implementation project(path: ':data-prepper-plugins:buffer-common')
26-
implementation project(path: ':data-prepper-plugins:common')
2726

2827

2928
testImplementation 'com.fasterxml.jackson.dataformat:jackson-dataformat-yaml'
30-
testImplementation project(':data-prepper-test:test-common')
3129
}

data-prepper-plugins/dynamodb-source/src/main/java/org/opensearch/dataprepper/plugins/source/dynamodb/DynamoDBSourceConfig.java

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -37,7 +37,7 @@ public class DynamoDBSourceConfig {
3737
private boolean acknowledgments = false;
3838

3939
@JsonProperty("shard_acknowledgment_timeout")
40-
private Duration shardAcknowledgmentTimeout = Duration.ofMinutes(30);
40+
private Duration shardAcknowledgmentTimeout = Duration.ofMinutes(10);
4141

4242
@JsonProperty("s3_data_file_acknowledgment_timeout")
4343
private Duration dataFileAcknowledgmentTimeout = Duration.ofMinutes(15);

data-prepper-plugins/dynamodb-source/src/main/java/org/opensearch/dataprepper/plugins/source/dynamodb/model/ShardCheckpointStatus.java

Lines changed: 0 additions & 65 deletions
This file was deleted.

data-prepper-plugins/dynamodb-source/src/main/java/org/opensearch/dataprepper/plugins/source/dynamodb/stream/ShardAcknowledgementManager.java

Lines changed: 0 additions & 259 deletions
This file was deleted.

0 commit comments

Comments
 (0)