[feat] Kafka: event-time driven checkpointing from message timestamp#541

Merged

tiankongdeguiji merged 12 commits into

alibaba:masterfrom

tiankongdeguiji:feat/kafka-event-time-checkpoint

Jun 9, 2026

Commits on Jun 6, 2026

[feat] Kafka: event-time driven checkpointing from message timestamp

tiankongdeguiji
and
claude
committed

Commits on Jun 8, 2026

[refactor] centralize checkpoint save policy in CheckpointManager + quorum

tiankongdeguiji
and
claude
committed
[refactor] carry Batch.data_timestamp in seconds (float), not ms

tiankongdeguiji
and
claude
committed
[refactor] normalize event-time ms->seconds in KafkaReader, not _build_batch

tiankongdeguiji
and
claude
committed
[test] parameterize event-time unit tests

tiankongdeguiji
and
claude
committed
[refactor] use -1.0 sentinel for Batch.data_timestamp instead of None

tiankongdeguiji
and
claude
committed
[refactor] generic gather_float_scalar in dist_util; tighten docs/comments

tiankongdeguiji
and
claude
committed