Skip to content

Commit d040181

Browse files
authored
Revert DDB checkpoint acknowledgment changes temporarily (opensearch-project#5967)
* Revert "Ensure shards are completed when last getRecords call has no records and no shardIterator (opensearch-project#5958)" This reverts commit 13049d3. Signed-off-by: Taylor Gray <tylgry@amazon.com> * Revert "Introduce checkpointing per shard to DDB source, via ShardAcknowledgementManager class (opensearch-project#5818)" This reverts commit dfc3c70. Signed-off-by: Taylor Gray <tylgry@amazon.com> --------- Signed-off-by: Taylor Gray <tylgry@amazon.com>
1 parent 5ba1c68 commit d040181

12 files changed

Lines changed: 311 additions & 835 deletions

File tree

data-prepper-plugins/dynamodb-source/build.gradle

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -23,9 +23,7 @@ dependencies {
2323

2424
implementation project(path: ':data-prepper-plugins:aws-plugin-api')
2525
implementation project(path: ':data-prepper-plugins:buffer-common')
26-
implementation project(path: ':data-prepper-plugins:common')
2726

2827

2928
testImplementation 'com.fasterxml.jackson.dataformat:jackson-dataformat-yaml'
30-
testImplementation project(':data-prepper-test:test-common')
3129
}

data-prepper-plugins/dynamodb-source/src/main/java/org/opensearch/dataprepper/plugins/source/dynamodb/DynamoDBSourceConfig.java

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -37,7 +37,7 @@ public class DynamoDBSourceConfig {
3737
private boolean acknowledgments = false;
3838

3939
@JsonProperty("shard_acknowledgment_timeout")
40-
private Duration shardAcknowledgmentTimeout = Duration.ofMinutes(30);
40+
private Duration shardAcknowledgmentTimeout = Duration.ofMinutes(10);
4141

4242
@JsonProperty("s3_data_file_acknowledgment_timeout")
4343
private Duration dataFileAcknowledgmentTimeout = Duration.ofMinutes(15);

data-prepper-plugins/dynamodb-source/src/main/java/org/opensearch/dataprepper/plugins/source/dynamodb/model/ShardCheckpointStatus.java

Lines changed: 0 additions & 65 deletions
This file was deleted.

data-prepper-plugins/dynamodb-source/src/main/java/org/opensearch/dataprepper/plugins/source/dynamodb/stream/ShardAcknowledgementManager.java

Lines changed: 0 additions & 259 deletions
This file was deleted.

0 commit comments

Comments
 (0)