Skip to content

Commit 9f11ede

Browse files
committed
feat: Add a changelog for the v5
Signed-off-by: Vincent Boutour <vincent.boutour@datadoghq.com>
1 parent 14e7d11 commit 9f11ede

1 file changed

Lines changed: 118 additions & 0 deletions

File tree

aws/logs_monitoring/CHANGELOG.md

Lines changed: 118 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,118 @@
1+
# Datadog Lambda Forwarder Changelog
2+
3+
## v5.0.0 - BREAKING CHANGES
4+
5+
### Overview
6+
7+
Version 5.0.0 of the Datadog Lambda Forwarder introduces several breaking changes that remove deprecated features and improve log filtering behavior. This release simplifies the forwarder configuration and aligns with modern AWS integration patterns.
8+
9+
### Breaking Changes
10+
11+
#### 1. Removed TCP Transport Support
12+
13+
**What Changed:**
14+
15+
- Removed the `DD_USE_TCP` / `DdUseTcp` environment variable and parameter
16+
- Deleted the TCP client implementation
17+
- All logs now **must** be sent via HTTP/HTTPS
18+
19+
**Migration Required:**
20+
21+
- Remove any configuration setting `DD_USE_TCP=true` or `DdUseTcp=true`
22+
- The forwarder will now exclusively use HTTP transport
23+
- If you were using TCP with custom ports (10516), these configurations will be ignored
24+
- The default HTTP endpoint is now `http-intake.logs.<DD_SITE>` on port 443
25+
26+
---
27+
28+
#### 2. Removed Deprecated PrivateLink Environment Variable
29+
30+
**What Changed:**
31+
32+
- Removed the `DD_USE_PRIVATE_LINK` / `DdUsePrivateLink` environment variable and parameter
33+
34+
**Migration Required:**
35+
36+
- Remove any configuration setting `DD_USE_PRIVATE_LINK=true`
37+
- **AWS PrivateLink is still fully supported**, but you must follow [PrivateLink documentation](https://docs.datadoghq.com/agent/guide/private-link/):
38+
1. Set up VPC endpoints for `api`, `http-logs.intake`, and `trace.agent` as documented
39+
2. Configure the forwarder with `DdUseVPC=true`
40+
3. Set `VPCSecurityGroupIds` and `VPCSubnetIds`
41+
42+
**Why This Changed:**
43+
44+
- The variable was deprecated since 4 years, we use the major release opportunity to cleanup with a breaking change.
45+
46+
---
47+
48+
#### 3. Changed Regex Matching Behavior for Log Filtering
49+
50+
**What Changed:**
51+
52+
- `IncludeAtMatch` / `INCLUDE_AT_MATCH` and `ExcludeAtMatch` / `EXCLUDE_AT_MATCH` regex patterns now match **only against the log message** itself
53+
- Previously, these patterns matched against the **entire JSON-formatted log**
54+
55+
**Migration Required:**
56+
57+
- **Review and update your filtering regex patterns**
58+
- If your patterns relied on matching against JSON structure or metadata fields, they will need to be rewritten
59+
- Example changes needed:
60+
- **Before (v4)**: `\"awsRegion\":\"us-east-1\"` (matched JSON with escaped quotes)
61+
- **After (v5)**: `"awsRegion":"us-east-1"` (matches the message content directly)
62+
- Patterns that matched the `message` field content should continue to work with minimal changes
63+
64+
---
65+
66+
### New Features
67+
68+
#### 4. Backend Storage Tag Enrichment
69+
70+
**Added:**
71+
72+
- New `DD_ENRICH_S3_TAGS` / `DdEnrichS3Tags` parameter (default: `true`)
73+
- New `DD_ENRICH_CLOUDWATCH_TAGS` / `DdEnrichCloudwatchTags` parameter (default: `true`)
74+
- These instruct the Datadog backend to automatically enrich logs with resource tags **after ingestion**
75+
- New cloudwatch tags can appear on logs, check your Datadog log index configuration to ensure smooth transition.
76+
77+
**Benefits:**
78+
79+
- **Reduces forwarder cost** and execution time
80+
- Provides the same tag enrichment as `DdFetchS3Tags` and `DdFetchLogGroupTags`
81+
- Requires [Resource Collection](https://docs.datadoghq.com/integrations/amazon-web-services/#resource-collection) enabled in your AWS integration
82+
83+
**Deprecation Notice:**
84+
85+
- `DdFetchS3Tags` is now marked as **DEPRECATED** in favor of `DdEnrichS3Tags`
86+
- `DdFetchLogGroupTags` is now marked as **DEPRECATED** in favor of `DdEnrichCloudwatchTags`
87+
- `DD_FETCH_S3_TAGS` now defaults to `false` (previously `true`)
88+
89+
---
90+
91+
### Upgrade Instructions
92+
93+
#### Pre-Upgrade Checklist
94+
95+
1. **Verify you're not using TCP transport:**
96+
97+
```bash
98+
aws lambda get-function-configuration --function-name "<YOUR_FORWARDER>" --query 'Environment.Variables.DD_USE_TCP'
99+
```
100+
101+
2. **Verify you're not using the deprecated PrivateLink variable:**
102+
103+
```bash
104+
aws lambda get-function-configuration --function-name "<YOUR_FORWARDER>" --query 'Environment.Variables.DD_USE_PRIVATE_LINK'
105+
```
106+
107+
3. **Review your log filtering patterns:**
108+
- If using `IncludeAtMatch` or `ExcludeAtMatch`, test your patterns against log messages only
109+
- Remove any JSON escaping (e.g., `\"` → `"`)
110+
111+
#### Testing
112+
113+
After upgrading:
114+
115+
1. Verify logs are being forwarded to Datadog
116+
2. Check that filtering rules still work as expected
117+
3. Confirm tag enrichment is working (check logs in Datadog Explorer)
118+
4. Monitor forwarder execution duration and errors in CloudWatch

0 commit comments

Comments
 (0)