Kinesis Client Library version 1.x end-of-support

[isb-david-lia]

A few hours ago AWS announced that they will be ending support for Amazon Kinesis Client Library (KCL) 1.x - link.

At the moment this plugin is using KCL version 1.15.

logstash-input-kinesis/logstash-input-kinesis.gemspec

Line 25 in 0c22932

spec.requirements << "jar 'com.amazonaws:amazon-kinesis-client', '1.15.0'"

Do you plan to update the plugin to use later versions of the KCL, please?

[jakub-olczyk]

@gtback @jmlrt @jsvd @ppf2 could you please take a look here?

The plugin seems to be abandoned(?) and this is a becoming a pressing issue for many people given the lack of updates for the plugin in recent years.

Thank you!

[jsvd]

hi @jakub-olczyk the maintainers at Elastic haven't prioritized this one given it's not one of the plugins in the default set that ships with Logstash, but I am happy to review a contribution that upgrades the kcl and sdk from 1.x if anyone is up to upgrading + doing at least some manual testing to confirm it works.

It looks like the plugin doesn't have to be upgraded immediately to 3.x, 2.7.2 would be enough, and we'd only have to handle the breaking changes from 2.0.0, mainly:

• worker vs scheduler execution model
• checkpointing may have changed
• recordprocessor and its factory changes