-
Notifications
You must be signed in to change notification settings - Fork 15
Expand file tree
/
Copy pathcpp.yml
More file actions
315 lines (315 loc) · 35.7 KB
/
cpp.yml
File metadata and controls
315 lines (315 loc) · 35.7 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
# yaml-language-server: $schema=https://raw.githubusercontent.com/DataDog/system-tests/refs/heads/main/utils/manifest/schema.json
---
# For features that are not yet available in the latest release,
# please specify a version greater than the current release using `>`.
# DO NOT SPECIFY A NON EXISTING RELEASE.
#
# For example, if the latest release is `v1.0.0` and a feature like Baggage
# is only supported on the `main` branch and in the upcoming release,
# use `>1.0.0` to indicate that requirement.
# NOTE: only parametric tests are run for cpp, there is no need to mark other tests as "missing_feature" here.
manifest:
tests/appsec/api_security/test_endpoints.py: irrelevant (language not implementing this feature)
tests/appsec/iast/source/test_parameter_value.py::TestParameterValue::test_source_reported: irrelevant
tests/appsec/test_only_python.py::Test_ImportError: irrelevant (specific tests for python tracer)
tests/appsec/test_traces.py::Test_AppSecEventSpanTags::test_header_collection: irrelevant (test)
tests/appsec/waf/test_reports.py::Test_Monitoring::test_waf_monitoring_optional: irrelevant (optional tags)
tests/debugger/test_debugger_exception_replay.py::Test_Debugger_Exception_Replay::test_exception_replay_firsthit: missing_feature (Implemented only for dotnet)
tests/debugger/test_debugger_exception_replay.py::Test_Debugger_Exception_Replay::test_exception_replay_outofmemory: missing_feature (Implemented only for dotnet)
tests/debugger/test_debugger_exception_replay.py::Test_Debugger_Exception_Replay::test_exception_replay_recursion_inlined: irrelevant (Test for specific bug in dotnet)
tests/debugger/test_debugger_exception_replay.py::Test_Debugger_Exception_Replay::test_exception_replay_stackoverflow: missing_feature (Implemented only for dotnet)
tests/debugger/test_debugger_probe_snapshot.py::Test_Debugger_Line_Probe_Snaphots::test_process_tags_snapshot: missing_feature (Not yet implemented)
tests/debugger/test_debugger_probe_snapshot.py::Test_Debugger_Line_Probe_Snaphots::test_process_tags_snapshot_svc: missing_feature (Not yet implemented)
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_error: bug (MLOB-1234)
tests/integrations/crossed_integrations/test_sqs.py::Test_SQS_PROPAGATION_VIA_AWS_XRAY_HEADERS: irrelevant (Localstack SQS does not support AWS Xray Header parsing)
tests/integrations/test_base_service.py::Test_BaseService_SqlSpan: irrelevant (/rasp/sqli endpoint is not available)
tests/integrations/test_cassandra.py::Test_Cassandra: missing_feature (Endpoint is not implemented on weblog)
tests/integrations/test_db_integrations_sql.py::Test_MsSql::test_db_jdbc_drive_classname: missing_feature (Apply only java)
tests/integrations/test_db_integrations_sql.py::Test_MySql::test_db_jdbc_drive_classname: missing_feature (Apply only java)
tests/integrations/test_db_integrations_sql.py::Test_Postgres::test_db_jdbc_drive_classname: missing_feature (Apply only java)
tests/integrations/test_db_integrations_sql.py::_BaseDatadogDbIntegrationTestClass::test_db_jdbc_drive_classname: missing_feature (Apply only java)
tests/integrations/test_dbm.py::Test_Dbm_Comment_Batch_Python_Aiomysql: irrelevant (These are python only tests.)
tests/integrations/test_dbm.py::Test_Dbm_Comment_Batch_Python_MysqlConnector: irrelevant (These are python only tests.)
tests/integrations/test_dbm.py::Test_Dbm_Comment_Batch_Python_Mysqldb: irrelevant (These are python only tests.)
tests/integrations/test_dbm.py::Test_Dbm_Comment_Batch_Python_Psycopg: irrelevant (These are python only tests.)
tests/integrations/test_dbm.py::Test_Dbm_Comment_Batch_Python_Pymysql: irrelevant (These are python only tests.)
tests/integrations/test_dbm.py::Test_Dbm_Comment_NodeJS_mysql2: irrelevant (These are nodejs only tests.)
tests/integrations/test_dbm.py::Test_Dbm_Comment_NodeJS_pg: irrelevant (These are nodejs only tests.)
tests/integrations/test_dbm.py::Test_Dbm_Comment_Python_Aiomysql: irrelevant (These are python only tests.)
tests/integrations/test_dbm.py::Test_Dbm_Comment_Python_Asyncpg: irrelevant (These are python only tests.)
tests/integrations/test_dbm.py::Test_Dbm_Comment_Python_MysqlConnector: irrelevant (These are python only tests.)
tests/integrations/test_dbm.py::Test_Dbm_Comment_Python_Mysqldb: irrelevant (These are python only tests.)
tests/integrations/test_dbm.py::Test_Dbm_Comment_Python_Psycopg: irrelevant (These are python only tests.)
tests/integrations/test_dbm.py::Test_Dbm_Comment_Python_Pymysql: irrelevant (These are python only tests.)
tests/integrations/test_dsm.py::Test_DsmKafka::test_dsm_kafka_without_cluster_id: irrelevant
tests/integrations/test_dsm.py::Test_DsmRabbitmq::test_dsm_rabbitmq_dotnet_legacy: irrelevant (legacy dotnet behavior)
tests/integrations/test_mongo.py::Test_Mongo: missing_feature (Endpoint is not implemented on weblog)
tests/integrations/test_service_overrides.py::Test_SqlServiceNameSource: irrelevant (Only implemented for Java)
tests/integrations/test_sql.py::Test_Sql: missing_feature (Endpoint is not implemented on weblog)
tests/otel_tracing_e2e/test_e2e.py::Test_OTelLogE2E: irrelevant
tests/otel_tracing_e2e/test_e2e.py::Test_OTelMetricE2E: irrelevant
tests/otel_tracing_e2e/test_e2e.py::Test_OTelTracingE2E: irrelevant
tests/parametric/test_128_bit_traceids.py::Test_128_Bit_Traceids: ">1.0.0"
tests/parametric/test_128_bit_traceids.py::Test_128_Bit_Traceids::test_b3single_128_bit_generation_disabled: missing_feature (propagation style not supported)
tests/parametric/test_128_bit_traceids.py::Test_128_Bit_Traceids::test_b3single_128_bit_generation_enabled: missing_feature (propagation style not supported)
tests/parametric/test_128_bit_traceids.py::Test_128_Bit_Traceids::test_b3single_128_bit_propagation: missing_feature (propagation style not supported)
tests/parametric/test_128_bit_traceids.py::Test_128_Bit_Traceids::test_b3single_128_bit_propagation_and_generation: missing_feature (propagation style not supported)
tests/parametric/test_config_consistency.py::Test_Config_Dogstatsd: missing_feature
tests/parametric/test_config_consistency.py::Test_Config_Dogstatsd::test_dogstatsd_default:
- declaration: incomplete_test_app (PHP parameteric app can not access the dogstatsd default values, this logic is internal to the tracer)
- declaration: missing_feature
tests/parametric/test_config_consistency.py::Test_Config_RateLimit: ">1.0.0"
tests/parametric/test_config_consistency.py::Test_Config_RateLimit::test_setting_trace_rate_limit_strict: missing_feature
tests/parametric/test_config_consistency.py::Test_Config_Tags: ">=2.0.0" # auto activation: might not be the earliest working version
tests/parametric/test_config_consistency.py::Test_Config_TraceAgentURL: ">1.0.0"
tests/parametric/test_config_consistency.py::Test_Config_TraceAgentURL::test_dd_agent_host_ipv6: missing_feature
tests/parametric/test_config_consistency.py::Test_Config_TraceAgentURL::test_dd_trace_agent_http_url_ipv6: '>=2.0.0' # Modified by easy win activation script
tests/parametric/test_config_consistency.py::Test_Config_TraceEnabled: ">1.0.0"
tests/parametric/test_config_consistency.py::Test_Config_TraceLogDirectory: missing_feature
tests/parametric/test_config_consistency.py::Test_Config_UnifiedServiceTagging: ">1.0.0"
tests/parametric/test_config_consistency.py::Test_Stable_Config_Default: missing_feature
tests/parametric/test_config_consistency.py::Test_Stable_Config_Default::test_extended_configs: missing_feature (extended configs are not supported)
tests/parametric/test_config_consistency.py::Test_Stable_Config_Rules: missing_feature
tests/parametric/test_crashtracking.py: missing_feature
tests/parametric/test_dynamic_configuration.py::TestDynamicConfigSamplingRules::test_remote_sampling_rules_retention:
- declaration: bug (APMAPI-863)
component_version: <=1.0.0
tests/parametric/test_dynamic_configuration.py::TestDynamicConfigSamplingRules::test_trace_sampling_rules_override_rate:
- declaration: bug (APMAPI-1595)
component_version: <=1.0.0
tests/parametric/test_dynamic_configuration.py::TestDynamicConfigSamplingRules::test_trace_sampling_rules_with_tags:
- declaration: bug (APMAPI-866)
component_version: <=1.0.0
tests/parametric/test_dynamic_configuration.py::TestDynamicConfigTracingEnabled::test_tracing_client_tracing_disable_one_way: irrelevant (APMAPI-1592)
tests/parametric/test_dynamic_configuration.py::TestDynamicConfigV1::test_log_injection_enabled: missing_feature (Tracer doesn't support automatic logs injection)
tests/parametric/test_dynamic_configuration.py::TestDynamicConfigV1::test_trace_sampling_rate_override_env:
- declaration: bug (APMAPI-863)
component_version: <=1.0.0
tests/parametric/test_dynamic_configuration.py::TestDynamicConfigV1::test_trace_sampling_rate_with_sampling_rules:
- declaration: bug (APMAPI-864)
component_version: <=1.0.0
tests/parametric/test_dynamic_configuration.py::TestDynamicConfigV1_EmptyServiceTargets: ">1.0.0"
tests/parametric/test_dynamic_configuration.py::TestDynamicConfigV1_ServiceTargets::test_match_service_target_case_insensitively:
- declaration: missing_feature (Tracer does case-sensitive checks for service and env)
component_version: <=1.0.0
tests/parametric/test_dynamic_configuration.py::TestDynamicConfigV1_ServiceTargets::test_not_match_service_target: irrelevant (APMAPI-1003)
tests/parametric/test_dynamic_configuration.py::TestDynamicConfigV2::test_capability_tracing_http_header_tags: irrelevant (The CPP tracer doesn't support http header tags)
tests/parametric/test_dynamic_configuration.py::TestDynamicConfigV2::test_capability_tracing_logs_injection: irrelevant (Tracer doesn't support automatic logs injection)
tests/parametric/test_ffe/test_dynamic_evaluation.py::Test_Feature_Flag_Dynamic_Evaluation: missing_feature
tests/parametric/test_headers_b3.py::Test_Headers_B3::test_headers_b3_extract_invalid: missing_feature (format of DD_TRACE_PROPAGATION_STYLE_EXTRACT not supported)
tests/parametric/test_headers_b3.py::Test_Headers_B3::test_headers_b3_extract_valid: missing_feature (format of DD_TRACE_PROPAGATION_STYLE_EXTRACT not supported)
tests/parametric/test_headers_b3.py::Test_Headers_B3::test_headers_b3_inject_valid: missing_feature (format of DD_TRACE_PROPAGATION_STYLE_EXTRACT not supported)
tests/parametric/test_headers_b3.py::Test_Headers_B3::test_headers_b3_migrated_extract_invalid: # Modified by easy win activation script
- declaration: missing_feature (Need to remove b3=b3multi alias)
component_version: <2.0.0
tests/parametric/test_headers_b3.py::Test_Headers_B3::test_headers_b3_migrated_extract_valid: missing_feature (Need to remove b3=b3multi alias)
tests/parametric/test_headers_b3.py::Test_Headers_B3::test_headers_b3_migrated_inject_valid: missing_feature (Need to remove b3=b3multi alias)
tests/parametric/test_headers_b3.py::Test_Headers_B3::test_headers_b3_migrated_propagate_invalid: missing_feature (Need to remove b3=b3multi alias)
tests/parametric/test_headers_b3.py::Test_Headers_B3::test_headers_b3_migrated_propagate_valid: missing_feature (Need to remove b3=b3multi alias)
tests/parametric/test_headers_b3.py::Test_Headers_B3::test_headers_b3_migrated_single_key_propagate_valid: missing_feature (Need to remove b3=b3multi alias)
tests/parametric/test_headers_b3.py::Test_Headers_B3::test_headers_b3_propagate_invalid: missing_feature (format of DD_TRACE_PROPAGATION_STYLE_EXTRACT not supported)
tests/parametric/test_headers_b3.py::Test_Headers_B3::test_headers_b3_propagate_valid: missing_feature (format of DD_TRACE_PROPAGATION_STYLE_EXTRACT not supported)
tests/parametric/test_headers_b3.py::Test_Headers_B3::test_headers_b3_single_key_propagate_valid: missing_feature (format of DD_TRACE_PROPAGATION_STYLE_EXTRACT not supported)
tests/parametric/test_headers_b3multi.py::Test_Headers_B3multi: ">1.0.0"
tests/parametric/test_headers_baggage.py::Test_Headers_Baggage: missing_feature
tests/parametric/test_headers_baggage.py::Test_Headers_Baggage::test_baggage_disable_settings_D003: irrelevant (The current default behaviour matches the future baggage disabled behaviour)
tests/parametric/test_headers_baggage.py::Test_Headers_Baggage::test_baggage_set_disabled_D007: irrelevant (The current default behaviour matches the future baggage disabled behaviour)
tests/parametric/test_headers_baggage.py::Test_Headers_Baggage_Span_Tags: '>=2.0.0' # Modified by easy win activation script
tests/parametric/test_headers_baggage.py::Test_Headers_Baggage_Span_Tags::test_baggage_span_tags_all: missing_feature # Created by easy win activation script
tests/parametric/test_headers_baggage.py::Test_Headers_Baggage_Span_Tags::test_baggage_span_tags_config_with_empty_keys: missing_feature # Created by easy win activation script
tests/parametric/test_headers_baggage.py::Test_Headers_Baggage_Span_Tags::test_baggage_span_tags_default: missing_feature # Created by easy win activation script
tests/parametric/test_headers_baggage.py::Test_Headers_Baggage_Span_Tags::test_baggage_span_tags_key_with_asterisk: missing_feature # Created by easy win activation script
tests/parametric/test_headers_baggage.py::Test_Headers_Baggage_Span_Tags::test_baggage_span_tags_specific_keys: missing_feature # Created by easy win activation script
tests/parametric/test_headers_datadog.py::Test_Headers_Datadog: ">1.0.0"
tests/parametric/test_headers_none.py::Test_Headers_None: ">1.0.0"
tests/parametric/test_headers_precedence.py::Test_Headers_Precedence: ">1.0.0"
? tests/parametric/test_headers_precedence.py::Test_Headers_Precedence::test_headers_precedence_propagationstyle_default_datadog_tracecontext
: - declaration: missing_feature (Implemented in 0.1.12)
component_version: <0.1.12
? tests/parametric/test_headers_precedence.py::Test_Headers_Precedence::test_headers_precedence_propagationstyle_default_tracecontext_datadog
: "irrelevant (\"Issue: tracecontext,Datadog was never the default configuration\")"
tests/parametric/test_headers_precedence.py::Test_Headers_Precedence::test_headers_precedence_propagationstyle_legacy:
- declaration: irrelevant (Implements the new 'datadog,tracecontext' default)
component_version: '>=0.1.12'
? tests/parametric/test_headers_precedence.py::Test_Headers_Precedence::test_headers_precedence_propagationstyle_tracecontext_last_extract_first_false_correctly_propagates_tracestate
: - declaration: missing_feature (Implemented in 0.1.12)
component_version: <0.1.12
? tests/parametric/test_headers_precedence.py::Test_Headers_Precedence::test_headers_precedence_propagationstyle_tracecontext_last_extract_first_true_correctly_propagates_tracestate
: missing_feature (DD_TRACE_PROPAGATION_EXTRACT_FIRST is not yet implemented)
tests/parametric/test_headers_tracecontext.py::Test_Headers_Tracecontext: ">1.0.0"
tests/parametric/test_headers_tracecontext.py::Test_Headers_Tracecontext::test_traceparent_duplicated: missing_feature (the first observed traceparent is used)
tests/parametric/test_headers_tracecontext.py::Test_Headers_Tracecontext::test_traceparent_version_illegal_characters: '>=2.0.0' # Modified by easy win activation script
tests/parametric/test_headers_tracecontext.py::Test_Headers_Tracecontext::test_tracestate_empty_header: missing_feature (the first observed tracestate is used)
tests/parametric/test_headers_tracecontext.py::Test_Headers_Tracecontext::test_tracestate_multiple_headers_different_keys: missing_feature (the first observed tracestate is used)
tests/parametric/test_headers_tracecontext.py::Test_Headers_Tracecontext::test_tracestate_w3c_p_extract:
- declaration: missing_feature (Not implemented)
component_version: <0.2.0
tests/parametric/test_headers_tracecontext.py::Test_Headers_Tracecontext::test_tracestate_w3c_p_extract_and_inject:
- declaration: missing_feature (Not implemented)
component_version: <0.2.0
tests/parametric/test_headers_tracecontext.py::Test_Headers_Tracecontext::test_tracestate_w3c_p_extract_datadog_w3c: '>=2.0.0' # Modified by easy win activation script
tests/parametric/test_headers_tracecontext.py::Test_Headers_Tracecontext::test_tracestate_w3c_p_inject:
- declaration: missing_feature (Not implemented)
component_version: <0.2.0
tests/parametric/test_headers_tracecontext.py::Test_Headers_Tracecontext::test_tracestate_w3c_p_phase_3_extract_first: missing_feature (Not implemented)
tests/parametric/test_headers_tracestate_dd.py::Test_Headers_Tracestate_DD: ">1.0.0"
? tests/parametric/test_headers_tracestate_dd.py::Test_Headers_Tracestate_DD::test_headers_tracestate_dd_evicts_32_or_greater_list_members
: bug (APMAPI-914)
tests/parametric/test_headers_tracestate_dd.py::Test_Headers_Tracestate_DD::test_headers_tracestate_dd_propagate_propagatedtags: # Modified by easy win activation script
- declaration: missing_feature (_dd.p.dm is reset to DEFAULT because we made the sampling decision)
component_version: <2.0.0
? tests/parametric/test_headers_tracestate_dd.py::Test_Headers_Tracestate_DD::test_headers_tracestate_dd_propagate_propagatedtags_change_sampling_reset_dm
: missing_feature (_dd.p.dm does not change when a sampling priority was extracted)
? tests/parametric/test_headers_tracestate_dd.py::Test_Headers_Tracestate_DD::test_headers_tracestate_dd_propagate_propagatedtags_change_sampling_same_dm
: missing_feature (_dd.p.dm is never dropped)
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_distinct_aggregationkeys_TS003: missing_feature (cpp has not implemented stats computation yet)
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_measured_spans_TS004: missing_feature (cpp has not implemented stats computation yet)
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_metrics_computed_after_span_finsh_TS009: missing_feature (cpp has not implemented stats computation yet)
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_metrics_msgpack_serialization_TS001: missing_feature (cpp has not implemented stats computation yet)
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_relative_error_TS008: missing_feature (relative error test is broken)
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_sample_rate_0_TS007: missing_feature (cpp has not implemented stats computation yet)
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_successes_errors_recorded_separately_TS006: missing_feature (cpp has not implemented stats computation yet)
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_top_level_TS005: missing_feature (cpp has not implemented stats computation yet)
tests/parametric/test_llm_observability/: irrelevant (library does not implement LLM Observability)
tests/parametric/test_otel_api_interoperability.py: irrelevant (library does not implement OpenTelemetry)
tests/parametric/test_otel_env_vars.py::Test_Otel_Env_Vars: missing_feature
tests/parametric/test_otel_env_vars.py::Test_Otel_Env_Vars::test_dd_trace_sample_ignore_parent_false: missing_feature (dd_trace_sample_ignore_parent requires an RFC, this feature is not implemented in any language)
tests/parametric/test_otel_env_vars.py::Test_Otel_Env_Vars::test_dd_trace_sample_ignore_parent_true: missing_feature (dd_trace_sample_ignore_parent requires an RFC, this feature is not implemented in any language)
tests/parametric/test_otel_logs.py: '>=2.0.0' # Modified by easy win activation script
tests/parametric/test_otel_logs.py::Test_FR01_Enable_OTLP_Log_Collection::test_otlp_logs_enabled: missing_feature # Created by easy win activation script
tests/parametric/test_otel_logs.py::Test_FR03_Resource_Attributes: missing_feature # Created by easy win activation script
tests/parametric/test_otel_logs.py::Test_FR04_Trace_Span_IDs: missing_feature # Created by easy win activation script
tests/parametric/test_otel_logs.py::Test_FR05_Custom_Endpoints: missing_feature # Created by easy win activation script
tests/parametric/test_otel_logs.py::Test_FR06_OTLP_Protocols: missing_feature # Created by easy win activation script
tests/parametric/test_otel_logs.py::Test_FR07_Host_Name: missing_feature # Created by easy win activation script
tests/parametric/test_otel_logs.py::Test_FR07_Host_Name::test_hostname_from_dd_hostname: irrelevant (DD_HOSTNAME is only supported in Python)
tests/parametric/test_otel_logs.py::Test_FR08_Custom_Headers: missing_feature # Created by easy win activation script
tests/parametric/test_otel_logs.py::Test_FR09_Log_Injection: missing_feature # Created by easy win activation script
tests/parametric/test_otel_logs.py::Test_FR10_Timeout_Configuration: missing_feature # Created by easy win activation script
tests/parametric/test_otel_logs.py::Test_FR11_Telemetry: missing_feature # Created by easy win activation script
tests/parametric/test_otel_logs.py::Test_FR12_Log_Levels: missing_feature # Created by easy win activation script
tests/parametric/test_otel_logs.py::Test_FR13_Scope_Fields: missing_feature # Created by easy win activation script
tests/parametric/test_otel_metrics.py: missing_feature
tests/parametric/test_otel_span_methods.py: irrelevant (library does not implement OpenTelemetry)
tests/parametric/test_otel_span_methods.py::Test_Otel_Span_Methods::test_otel_record_exception_sets_handling_stack_in_go: irrelevant
tests/parametric/test_otel_span_with_baggage.py::Test_Otel_Span_With_Baggage: missing_feature
tests/parametric/test_otel_tracer.py::Test_Otel_Tracer::test_otel_force_flush: irrelevant (library does not implement OpenTelemetry)
tests/parametric/test_otel_tracer.py::Test_Otel_Tracer::test_otel_simple_trace: irrelevant (library does not implement OpenTelemetry)
tests/parametric/test_parametric_endpoints.py::Test_Parametric_DDSpan_Add_Link: missing_feature (add_link is not supported)
tests/parametric/test_parametric_endpoints.py::Test_Parametric_DDSpan_Set_Error: bug (APMAPI-778) # The expected error status is not set
tests/parametric/test_parametric_endpoints.py::Test_Parametric_DDSpan_Set_Metric: missing_feature (Tracer does not provide a public method for directly setting a span metric)
tests/parametric/test_parametric_endpoints.py::Test_Parametric_DDSpan_Set_Resource: incomplete_test_app (set_resource endpoint is not implemented)
tests/parametric/test_parametric_endpoints.py::Test_Parametric_DDSpan_Start: ">=2.0.0" # auto activation: might not be the earliest working version
tests/parametric/test_parametric_endpoints.py::Test_Parametric_DDTrace_Baggage: missing_feature (baggage is not supported)
tests/parametric/test_parametric_endpoints.py::Test_Parametric_DDTrace_Config: ">=2.0.0" # auto activation: might not be the earliest working version
tests/parametric/test_parametric_endpoints.py::Test_Parametric_DDTrace_Crash: incomplete_test_app (crash endpoint is not implemented)
tests/parametric/test_parametric_endpoints.py::Test_Parametric_DDTrace_Current_Span: incomplete_test_app (current_span endpoint is not implemented)
tests/parametric/test_parametric_endpoints.py::Test_Parametric_DDTrace_Extract_Headers: ">1.0.0"
tests/parametric/test_parametric_endpoints.py::Test_Parametric_FFE_Start: missing_feature # cpp tracer does not support the OpenTelemetry API, otel parametric endpoints are not implemented
tests/parametric/test_parametric_endpoints.py::Test_Parametric_OtelSpan_End: missing_feature (otel api is not supported)
tests/parametric/test_parametric_endpoints.py::Test_Parametric_OtelSpan_Events: missing_feature (otel api is not supported)
tests/parametric/test_parametric_endpoints.py::Test_Parametric_OtelSpan_Is_Recording: missing_feature (otel api is not supported)
tests/parametric/test_parametric_endpoints.py::Test_Parametric_OtelSpan_Set_Attribute: missing_feature (otel api is not supported)
tests/parametric/test_parametric_endpoints.py::Test_Parametric_OtelSpan_Set_Name: missing_feature (otel api is not supported)
tests/parametric/test_parametric_endpoints.py::Test_Parametric_OtelSpan_Set_Status: missing_feature (otel api is not supported)
tests/parametric/test_parametric_endpoints.py::Test_Parametric_OtelSpan_Start: missing_feature (otel api is not supported)
tests/parametric/test_parametric_endpoints.py::Test_Parametric_Otel_Baggage: missing_feature (otel api is not supported)
tests/parametric/test_parametric_endpoints.py::Test_Parametric_Otel_Current_Span: missing_feature (otel api is not supported)
tests/parametric/test_parametric_endpoints.py::Test_Parametric_Otel_Trace_Flush: missing_feature (otel api is not supported)
tests/parametric/test_parametric_endpoints.py::Test_Parametric_Write_Log: missing_feature
tests/parametric/test_parametric_endpoints.py::Test_Parametric_Write_Log::test_create_logger: incomplete_test_app (Logs endpoint is only implemented in python and node.js app)
tests/parametric/test_parametric_endpoints.py::Test_Parametric_Write_Log::test_write_log: incomplete_test_app (Logs endpoint is only implemented in python and node.js app)
tests/parametric/test_partial_flushing.py::Test_Partial_Flushing: '>=2.0.0' # Modified by easy win activation script
tests/parametric/test_partial_flushing.py::Test_Partial_Flushing::test_partial_flushing_one_span: missing_feature # Created by easy win activation script
tests/parametric/test_partial_flushing.py::Test_Partial_Flushing::test_partial_flushing_one_span_default: missing_feature # Created by easy win activation script
tests/parametric/test_process_discovery.py::Test_ProcessDiscovery: ">1.0.0"
tests/parametric/test_process_discovery.py::Test_ProcessDiscovery::test_metadata_content_with_process_tags: # Modified by easy win activation script
- declaration: bug (APMAPI-1744)
component_version: <2.0.0
tests/parametric/test_process_discovery.py::Test_ProcessDiscovery::test_metadata_content_without_process_tags: # Easy win for all weblogs and version 2.0.0
- declaration: bug (APMAPI-1772)
component_version: '>=2.0.0'
tests/parametric/test_sampling_delegation.py::Test_Decisionless_Extraction: ">1.0.0"
tests/parametric/test_sampling_manual.py::Test_Manual_Sampling: bug (APMAPI-1720) # Manual keep did not override the upstream drop decision
tests/parametric/test_sampling_span_tags.py::Test_Knuth_Sample_Rate: '>=2.1.0'
tests/parametric/test_sampling_span_tags.py::Test_Sampling_Span_Tags::test_tags_appsec_enabled_sst011: bug (APMAPI-737)
tests/parametric/test_sampling_span_tags.py::Test_Sampling_Span_Tags::test_tags_child_dropped_sst001: bug (APMAPI-737)
tests/parametric/test_sampling_span_tags.py::Test_Sampling_Span_Tags::test_tags_child_kept_sst007: bug (APMAPI-737)
tests/parametric/test_sampling_span_tags.py::Test_Sampling_Span_Tags::test_tags_defaults_rate_1_and_rate_limit_0_sst008: bug (APMAPI-737)
? tests/parametric/test_sampling_span_tags.py::Test_Sampling_Span_Tags::test_tags_defaults_rate_1_and_rate_limit_3_and_rule_0_sst009
: bug (APMAPI-737)
tests/parametric/test_sampling_span_tags.py::Test_Sampling_Span_Tags::test_tags_defaults_rate_1_and_rate_limit_3_sst010: bug (APMAPI-737)
tests/parametric/test_sampling_span_tags.py::Test_Sampling_Span_Tags::test_tags_defaults_rate_1_and_rule_0_sst006: bug (APMAPI-737)
tests/parametric/test_sampling_span_tags.py::Test_Sampling_Span_Tags::test_tags_defaults_rate_1_and_rule_1_sst005: bug (APMAPI-737)
tests/parametric/test_sampling_span_tags.py::Test_Sampling_Span_Tags::test_tags_defaults_rate_1_sst003: bug (APMAPI-737)
tests/parametric/test_sampling_span_tags.py::Test_Sampling_Span_Tags::test_tags_defaults_rate_tiny_sst004: bug (APMAPI-737)
tests/parametric/test_sampling_span_tags.py::Test_Sampling_Span_Tags::test_tags_defaults_sst002: # Modified by easy win activation script
- declaration: bug (APMAPI-737)
component_version: <2.0.0
tests/parametric/test_span_events.py: missing_feature
tests/parametric/test_span_links.py: missing_feature
? tests/parametric/test_span_sampling.py::Test_Span_Sampling::test_child_span_selected_and_root_dropped_by_sss_when_dropping_policy_is_active017
: missing_feature (span dropping policy not implemented)
tests/parametric/test_span_sampling.py::Test_Span_Sampling::test_entire_trace_dropped_when_dropping_policy_is_active018: missing_feature (span dropping policy not implemented)
tests/parametric/test_span_sampling.py::Test_Span_Sampling::test_keep_span_with_stats_computation_sss010: missing_feature (cpp has not implemented stats computation yet)
tests/parametric/test_span_sampling.py::Test_Span_Sampling::test_multi_rule_independent_rate_limiters_sss013: flaky (APMAPI-933)
? tests/parametric/test_span_sampling.py::Test_Span_Sampling::test_root_span_selected_and_child_dropped_by_sss_when_dropping_policy_is_active016
: missing_feature (span dropping policy not implemented)
tests/parametric/test_span_sampling.py::Test_Span_Sampling::test_single_rule_always_keep_span_sampling_sss011: missing_feature (manual.drop span tag is not applied)
tests/parametric/test_span_sampling.py::Test_Span_Sampling::test_single_rule_rate_limiter_span_sampling_sss008: bug (APMAPI-1052)
tests/parametric/test_span_sampling.py::Test_Span_Sampling::test_single_rule_with_head_and_rule_trace_sampling_drop_020:
- declaration: bug (APMAPI-1545)
component_version: <=1.0.0
tests/parametric/test_span_sampling.py::Test_Span_Sampling::test_single_rule_with_head_and_rule_trace_sampling_keep_019:
- declaration: bug (APMAPI-1545)
component_version: <=1.0.0
tests/parametric/test_telemetry.py::Test_Consistent_Configs: missing_feature
tests/parametric/test_telemetry.py::Test_Environment::test_telemetry_otel_env_hiding: missing_feature (Not implemented)
tests/parametric/test_telemetry.py::Test_Environment::test_telemetry_otel_env_invalid: missing_feature (Not implemented)
tests/parametric/test_telemetry.py::Test_Stable_Configuration_Origin: missing_feature
? tests/parametric/test_telemetry.py::Test_Stable_Configuration_Origin::test_stable_configuration_origin_extended_configs_good_use_case
: missing_feature (extended configs are not supported)
? tests/parametric/test_telemetry.py::Test_Stable_Configuration_Origin::test_stable_configuration_origin_extended_configs_temporary_use_case
: missing_feature (extended configs are not supported)
tests/parametric/test_telemetry.py::Test_TelemetryInstallSignature: ">1.0.0"
tests/parametric/test_telemetry.py::Test_TelemetrySCAEnvVar: '>=2.0.0' # Modified by easy win activation script
tests/parametric/test_telemetry.py::Test_TelemetrySCAEnvVar::test_telemetry_sca_enabled_propagated: missing_feature # Created by easy win activation script
tests/parametric/test_telemetry.py::Test_TelemetrySCAEnvVar::test_telemetry_sca_enabled_propagated_specifics: irrelevant
tests/parametric/test_telemetry.py::Test_TelemetrySSIConfigs: missing_feature
tests/parametric/test_trace_sampling.py::Test_Trace_Sampling_Globs::test_field_case_insensitivity: # Modified by easy win activation script
- declaration: bug (APMAPI-908)
component_version: <2.0.0
tests/parametric/test_trace_sampling.py::Test_Trace_Sampling_Tags_Feb2024_Revision::test_metric_existence: missing_feature (No metric interface)
tests/parametric/test_trace_sampling.py::Test_Trace_Sampling_Tags_Feb2024_Revision::test_metric_matching: missing_feature (No metric interface)
tests/parametric/test_trace_sampling.py::Test_Trace_Sampling_With_W3C::test_distributed_headers_synthetics_sampling_decision: bug (APMAPI-1563)
tests/parametric/test_tracer.py::Test_ProcessTags_ServiceName: missing_feature
tests/parametric/test_tracer.py::Test_Tracer::test_tracer_span_top_level_attributes: missing_feature (metrics cannot be set manually)
tests/parametric/test_tracer.py::Test_TracerBaseService: missing_feature (_dd.base_service is not implemented)
tests/parametric/test_tracer.py::Test_TracerSCITagging: missing_feature
tests/parametric/test_tracer.py::Test_TracerServiceNameSource: irrelevant
tests/parametric/test_tracer.py::Test_TracerUniversalServiceTagging::test_tracer_service_name_environment_variable: "missing_feature (FIXME: library test client sets empty string as the service name)"
tests/parametric/test_tracer_flare.py: '>=2.0.0' # Modified by easy win activation script
tests/parametric/test_tracer_flare.py::TestTracerFlareV1::test_flare_log_level_order: missing_feature # Created by easy win activation script
tests/parametric/test_tracer_flare.py::TestTracerFlareV1::test_no_tracer_flare_for_other_task_types: missing_feature # Created by easy win activation script
tests/parametric/test_tracer_flare.py::TestTracerFlareV1::test_tracer_flare: missing_feature # Created by easy win activation script
tests/parametric/test_tracer_flare.py::TestTracerFlareV1::test_tracer_flare_content: missing_feature # Created by easy win activation script
tests/parametric/test_tracer_flare.py::TestTracerFlareV1::test_tracer_flare_content_with_debug: missing_feature # Created by easy win activation script
tests/parametric/test_tracer_flare.py::TestTracerFlareV1::test_tracer_flare_with_debug: missing_feature # Created by easy win activation script
tests/parametric/test_tracer_flare.py::TestTracerFlareV1::test_tracer_profiling_notracing_flare_content: missing_feature # Created by easy win activation script
tests/stats/test_stats.py::Test_Stats_Service_Source: irrelevant (Only implemented for Java)
tests/test_library_conf.py::Test_ExtractBehavior_Default::test_multiple_tracecontexts: missing_feature (baggage is not implemented, also remove DD_TRACE_PROPAGATION_STYLE_EXTRACT workaround in containers.py)
tests/test_library_conf.py::Test_ExtractBehavior_Default::test_single_tracecontext: missing_feature (baggage is not implemented, also remove DD_TRACE_PROPAGATION_STYLE_EXTRACT workaround in containers.py)
tests/test_library_conf.py::Test_ExtractBehavior_Ignore::test_multiple_tracecontexts: missing_feature (baggage is not implemented, also remove DD_TRACE_PROPAGATION_STYLE_EXTRACT workaround in containers.py)
tests/test_library_conf.py::Test_ExtractBehavior_Ignore::test_single_tracecontext: missing_feature (baggage is not implemented, also remove DD_TRACE_PROPAGATION_STYLE_EXTRACT workaround in containers.py)
tests/test_library_conf.py::Test_ExtractBehavior_Restart::test_multiple_tracecontexts: missing_feature (baggage is not implemented, also remove DD_TRACE_PROPAGATION_STYLE_EXTRACT workaround in containers.py)
tests/test_library_conf.py::Test_ExtractBehavior_Restart::test_multiple_tracecontexts_with_overrides: missing_feature (baggage is not implemented, also remove DD_TRACE_PROPAGATION_STYLE_EXTRACT workaround in containers.py)
tests/test_library_conf.py::Test_ExtractBehavior_Restart::test_single_tracecontext: missing_feature (baggage is not implemented, also remove DD_TRACE_PROPAGATION_STYLE_EXTRACT workaround in containers.py)
tests/test_library_conf.py::Test_ExtractBehavior_Restart_With_Extract_First::test_multiple_tracecontexts: missing_feature (baggage is not implemented, also remove DD_TRACE_PROPAGATION_STYLE_EXTRACT workaround in containers.py)
tests/test_library_conf.py::Test_ExtractBehavior_Restart_With_Extract_First::test_single_tracecontext: missing_feature (baggage is not implemented, also remove DD_TRACE_PROPAGATION_STYLE_EXTRACT workaround in containers.py)
tests/test_library_conf.py::Test_HeaderTags_DynamicConfig::test_tracing_client_http_header_tags_apm_multiconfig: missing_feature (APM_TRACING_MULTICONFIG is not supported in any language yet)
tests/test_library_logs.py::Test_NoExceptions::test_dotnet: irrelevant (only for .NET)
tests/test_library_logs.py::Test_NoExceptions::test_java_logs: irrelevant (only for Java)
tests/test_library_logs.py::Test_NoExceptions::test_java_telemetry_logs: irrelevant (only for Java)
tests/test_otlp_runtime_metrics.py::Test_OtlpRuntimeMetrics: missing_feature
tests/test_telemetry.py::Test_Telemetry::test_telemetry_message_has_datadog_container_id: "irrelevant (cgroup in weblog is 0::/, so this test can't work)"
tests/test_telemetry.py::Test_Telemetry::test_telemetry_message_required_headers: missing_feature