Skip to content

Clarify JSON array ingestion behavior for S3 log files#1086

Merged
estherk15 merged 2 commits into
masterfrom
esther/docs-13685-lambda-forwarder-json-format
Mar 26, 2026
Merged

Clarify JSON array ingestion behavior for S3 log files#1086
estherk15 merged 2 commits into
masterfrom
esther/docs-13685-lambda-forwarder-json-format

Conversation

@estherk15
Copy link
Copy Markdown
Contributor

@estherk15 estherk15 commented Mar 26, 2026

What does this PR do?

Adds a troubleshooting subsection to the Forwarder README clarifying that S3 log files containing JSON arrays are ingested as a single log event, and that newline-delimited JSON (NDJSON) is required to ingest each entry as a separate event.

Motivation

Customers sending logs from S3 via the Lambda Log Forwarder have encountered unexpected behavior when their log files contain JSON arrays. The current documentation states that logs must be in JSON format but does not specify that JSON arrays are treated as a single event. This change surfaces that requirement upfront to help users avoid ingestion issues.

Testing Guidelines

No functional changes — documentation update only.

Additional Notes

This change was requested in DOCS-13685 based on customer feedback.

Types of changes

  • Documentation update

Adds a troubleshooting section explaining that JSON arrays in S3 log
files are ingested as a single event and that NDJSON format is required
for separate log entries.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@estherk15 estherk15 requested a review from a team as a code owner March 26, 2026 15:34
@github-actions github-actions Bot added the aws label Mar 26, 2026
Copy link
Copy Markdown
Contributor

@maycmlee maycmlee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a tiny suggestion, but approving!

Comment thread aws/logs_monitoring/README.md Outdated
Co-authored-by: May Lee <mayl@alumni.cmu.edu>
@estherk15 estherk15 merged commit 26395a8 into master Mar 26, 2026
10 checks passed
@estherk15 estherk15 deleted the esther/docs-13685-lambda-forwarder-json-format branch March 26, 2026 18:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants