Skip to content

Commit aa961aa

Browse files
authored
Merge pull request #2106 from elementary-data/fix-log-integrations-docs
fixed docs
2 parents 273ac06 + ec3f3ec commit aa961aa

3 files changed

Lines changed: 37 additions & 65 deletions

File tree

docs/cloud/integrations/log-streaming/datadog.mdx

Lines changed: 12 additions & 30 deletions
Original file line numberDiff line numberDiff line change
@@ -72,40 +72,22 @@ The log streaming configuration applies to your entire workspace. All logs match
7272

7373
Logs are sent to Datadog with the following structure:
7474

75-
### User Activity Logs
76-
77-
Each user activity log entry includes:
78-
7975
- `timestamp`: ISO 8601 timestamp of the event
76+
- `log_type`: The type of log (`audit` for user activity logs, `system` for system logs)
8077
- `status`: Log level (`info` for successful actions, `error` for failed actions)
81-
- `message`: Human-readable description of the action
82-
- `service`: Service name (configurable, defaults to `elementary`)
83-
- `source`: Source tag (configurable, defaults to `elementary-cloud`)
84-
- `dd.tags`: Additional tags including:
85-
- `log_type:audit`
86-
- `action:<action_name>` (e.g., `user_login`, `create_test`)
87-
- `success:<true|false>`
88-
- `user_email:<user_email>`
89-
- `env_id:<environment_id>` (if applicable)
90-
- `env_name:<environment_name>` (if applicable)
91-
- Custom attributes from the event content (JSON parsed)
92-
93-
### System Logs
94-
95-
Each system log entry includes:
96-
97-
- `timestamp`: ISO 8601 timestamp of the event
98-
- `status`: Log level (`info` for successful operations, `error` for failed operations)
99-
- `message`: Human-readable description of the system event
10078
- `service`: Service name (configurable, defaults to `elementary`)
10179
- `source`: Source tag (configurable, defaults to `elementary-cloud`)
80+
- `event_name`: The specific action that was performed (e.g., `user_login`, `create_test`)
81+
- `success`: Boolean indicating whether the action completed successfully
82+
- `user_email`: User email address (only present in audit logs)
83+
- `user_name`: User display name (only present in audit logs)
84+
- `env_id`: Environment identifier (empty for account-level actions)
85+
- `env_name`: Environment name (empty for account-level actions)
86+
- `event_content`: Additional context-specific information as a JSON object
10287
- `dd.tags`: Additional tags including:
103-
- `log_type:system`
104-
- `action:<action_name>` (e.g., `dbt_data_sync_completed`, `alerts_sent`)
105-
- `success:<true|false>`
88+
- `log_type:<log_type>` (e.g., `audit`, `system`)
89+
- `event_name:<event_name>` (e.g., `user_login`, `create_test`)
10690
- `env_id:<environment_id>` (if applicable)
107-
- `env_name:<environment_name>` (if applicable)
108-
- Custom attributes from the event content (JSON parsed)
10991

11092
## Viewing Logs in Datadog
11193

@@ -115,8 +97,8 @@ You can filter logs using:
11597
- `source:elementary-cloud` - All Elementary logs
11698
- `log_type:audit` - User activity logs only
11799
- `log_type:system` - System logs only
118-
- `action:<action_name>` - Specific action types
119-
- `env_name:<environment_name>` - Logs from a specific environment
100+
- `event_name:<event_name>` - Specific action types
101+
- `env_id:<environment_id>` - Logs from a specific environment
120102
- `success:false` - Failed operations only
121103

122104
<Frame>

docs/cloud/integrations/log-streaming/gcs.mdx

Lines changed: 10 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -121,16 +121,13 @@ Each user activity log entry includes:
121121
{
122122
"timestamp": "2024-01-15T14:30:45.123456Z",
123123
"log_type": "audit",
124-
"action": "user_login",
124+
"event_name": "user_login",
125125
"success": true,
126-
"user": {
127-
"id": "usr_abcdef1234567890",
128-
"email": "john.doe@example.com",
129-
"name": "John Doe"
130-
},
126+
"user_email": "john.doe@example.com",
127+
"user_name": "John Doe",
131128
"env_id": "env_7890123456abcdef",
132129
"env_name": "Production",
133-
"data": {
130+
"event_content": {
134131
"additional": "context"
135132
}
136133
}
@@ -144,11 +141,11 @@ Each system log entry includes:
144141
{
145142
"timestamp": "2024-01-15T14:30:45.123456Z",
146143
"log_type": "system",
147-
"action": "dbt_data_sync_completed",
144+
"event_name": "dbt_data_sync_completed",
148145
"success": true,
149146
"env_id": "env_7890123456abcdef",
150147
"env_name": "Production",
151-
"data": {
148+
"event_content": {
152149
"environment_id": "env_789",
153150
"environment_name": "Production"
154151
}
@@ -159,15 +156,13 @@ Each system log entry includes:
159156

160157
- `timestamp`: ISO 8601 timestamp of the event (UTC)
161158
- `log_type`: Either `"audit"` for user activity logs or `"system"` for system logs
162-
- `action`: The specific action that was performed (e.g., `user_login`, `create_test`, `dbt_data_sync_completed`)
159+
- `event_name`: The specific action that was performed (e.g., `user_login`, `create_test`, `dbt_data_sync_completed`)
163160
- `success`: Boolean indicating whether the action completed successfully
164-
- `user`: User information (only present in audit logs)
165-
- `id`: User ID
166-
- `email`: User email address
167-
- `name`: User display name
161+
- `user_email`: User email address (only present in audit logs)
162+
- `user_name`: User display name (only present in audit logs)
168163
- `env_id`: Environment identifier (empty string for account-level actions)
169164
- `env_name`: Environment name (empty string for account-level actions)
170-
- `data`: Additional context-specific information as a JSON object
165+
- `event_content`: Additional context-specific information as a JSON object
171166

172167
<Frame>
173168
<div className="dark:bg-white rounded-md p-4">

docs/cloud/integrations/log-streaming/splunk.mdx

Lines changed: 15 additions & 20 deletions
Original file line numberDiff line numberDiff line change
@@ -81,16 +81,13 @@ Each user activity log entry includes:
8181
{
8282
"timestamp": "2024-01-15T14:30:45.123456Z",
8383
"log_type": "audit",
84-
"action": "user_login",
84+
"event_name": "user_login",
8585
"success": true,
86-
"user": {
87-
"id": "usr_abcdef1234567890",
88-
"email": "john.doe@example.com",
89-
"name": "John Doe"
90-
},
86+
"user_email": "john.doe@example.com",
87+
"user_name": "John Doe",
9188
"env_id": "env_7890123456abcdef",
9289
"env_name": "Production",
93-
"data": {
90+
"event_content": {
9491
"additional": "context"
9592
}
9693
}
@@ -104,11 +101,11 @@ Each system log entry includes:
104101
{
105102
"timestamp": "2024-01-15T14:30:45.123456Z",
106103
"log_type": "system",
107-
"action": "dbt_data_sync_completed",
104+
"event_name": "dbt_data_sync_completed",
108105
"success": true,
109106
"env_id": "env_7890123456abcdef",
110107
"env_name": "Production",
111-
"data": {
108+
"event_content": {
112109
"environment_id": "env_789",
113110
"environment_name": "Production"
114111
}
@@ -119,15 +116,13 @@ Each system log entry includes:
119116

120117
- `timestamp`: ISO 8601 timestamp of the event (UTC)
121118
- `log_type`: Either `"audit"` for user activity logs or `"system"` for system logs
122-
- `action`: The specific action that was performed (e.g., `user_login`, `create_test`, `dbt_data_sync_completed`)
119+
- `event_name`: The specific action that was performed (e.g., `user_login`, `create_test`, `dbt_data_sync_completed`)
123120
- `success`: Boolean indicating whether the action completed successfully
124-
- `user`: User information (only present in audit logs)
125-
- `id`: User ID
126-
- `email`: User email address
127-
- `name`: User display name
128-
- `env_id`: Environment identifier (empty string for account-level actions)
129-
- `env_name`: Environment name (empty string for account-level actions)
130-
- `data`: Additional context-specific information as a JSON object
121+
- `user_email`: User email address
122+
- `user_name`: User display name
123+
- `env_id`: Environment identifier (empty for account-level actions)
124+
- `env_name`: Environment name (empty for account-level actions)
125+
- `event_content`: Additional context-specific information as a JSON object
131126

132127
<Frame>
133128
<div className="dark:bg-white rounded-md p-4">
@@ -154,8 +149,8 @@ source="elementary-cloud" log_type="audit"
154149
source="elementary-cloud" log_type="system"
155150
156151
# Search for specific actions
157-
source="elementary-cloud" action="user_login"
158-
source="elementary-cloud" action="dbt_data_sync_completed"
152+
source="elementary-cloud" event_name="user_login"
153+
source="elementary-cloud" event_name="dbt_data_sync_completed"
159154
160155
# Filter by environment
161156
source="elementary-cloud" env_name="Production"
@@ -164,7 +159,7 @@ source="elementary-cloud" env_name="Production"
164159
source="elementary-cloud" success=false
165160
166161
# Search by user email
167-
source="elementary-cloud" user.email="john.doe@example.com"
162+
source="elementary-cloud" user_email="john.doe@example.com"
168163
```
169164

170165
## Disabling Log Streaming

0 commit comments

Comments
 (0)