Skip to content

Commit 62a89ee

Browse files
chore: activate easy wins for @DataDog/ml-observability
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
1 parent 558aa01 commit 62a89ee

1 file changed

Lines changed: 29 additions & 7 deletions

File tree

manifests/nodejs.yml

Lines changed: 29 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1697,14 +1697,34 @@ manifest:
16971697
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Targeting_Key_Optional: bug (FFL-1730)
16981698
tests/integration_frameworks/llm/anthropic/test_anthropic_apm.py::TestAnthropicApmMessages: *ref_5_71_0
16991699
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages: *ref_5_71_0
1700-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create: missing_feature # ephemeral cache TTL metrics not yet released
1701-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_content_block: missing_feature # ephemeral cache TTL metrics not yet released
1700+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create: # ephemeral cache TTL metrics not yet released
1701+
- weblog_declaration:
1702+
'*': missing_feature
1703+
anthropic-js@0.71.0: '>=5.108.0'
1704+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_content_block: # ephemeral cache TTL metrics not yet released
1705+
- weblog_declaration:
1706+
'*': missing_feature
1707+
anthropic-js@0.71.0: '>=5.108.0'
17021708
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_error: bug (MLOB-1234)
17031709
? tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_multiple_system_prompts
1704-
: missing_feature # ephemeral cache TTL metrics not yet released
1705-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_redact_image_input: missing_feature # ephemeral cache TTL metrics not yet released
1706-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_stream_method: missing_feature # ephemeral cache TTL metrics not yet released
1707-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_tool_result: bug (MLOB-1234)
1710+
: # ephemeral cache TTL metrics not yet released
1711+
- weblog_declaration:
1712+
'*': missing_feature
1713+
anthropic-js@0.71.0: '>=5.108.0'
1714+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_redact_image_input: # ephemeral cache TTL metrics not yet released
1715+
- weblog_declaration:
1716+
'*': missing_feature
1717+
anthropic-js@0.71.0: '>=5.108.0'
1718+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_stream_method: # ephemeral cache TTL metrics not yet released
1719+
- weblog_declaration:
1720+
'*': missing_feature
1721+
anthropic-js@0.71.0: '>=5.108.0'
1722+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_tool_result: # TODO: a lower version might be supported
1723+
- declaration: bug (MLOB-1234)
1724+
component_version: <5.108.0
1725+
weblog: [anthropic-js@0.71.0]
1726+
- declaration: bug (MLOB-1234)
1727+
excluded_weblog: [anthropic-js@0.71.0]
17081728
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_with_tools: missing_feature (Node.js LLM Observability Anthropic integration does not submit tool definitions)
17091729
tests/integration_frameworks/llm/google_genai/test_google_genai_apm.py::TestGoogleGenAiEmbedContent: *ref_5_81_0
17101730
tests/integration_frameworks/llm/google_genai/test_google_genai_apm.py::TestGoogleGenAiGenerateContent: *ref_5_81_0
@@ -2079,7 +2099,9 @@ manifest:
20792099
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_sample_rate_0_TS007: "missing_feature (CSS v1.2.0: dd-trace-js does not drop P0 traces when DD_TRACE_SAMPLE_RATE=0; traces are still emitted with _sampling_priority_v1=-1 instead of being dropped client-side)"
20802100
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_successes_errors_recorded_separately_TS006: "missing_feature (CSS v1.2.0: dd-trace-js groups error and success spans into the same aggregation bucket; ErrorSummary distinct from OkSummary is not produced)"
20812101
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_top_level_TS005: "missing_feature (CSS v1.2.0: dd-trace-js does not produce stats for nested top-level (service-entry) child spans when parent and child are in different services; only the outer span yields a stats entry)"
2082-
tests/parametric/test_llm_observability/test_llm_observability.py::Test_CostTags: missing_feature (cost_tags not yet supported in Node.js LLMObs SDK)
2102+
tests/parametric/test_llm_observability/test_llm_observability.py::Test_CostTags: # TODO: a lower version might be supported
2103+
- declaration: missing_feature (cost_tags not yet supported in Node.js LLMObs SDK)
2104+
component_version: <5.108.0
20832105
tests/parametric/test_llm_observability/test_llm_observability.py::Test_Enablement: *ref_5_66_0
20842106
tests/parametric/test_llm_observability/test_llm_observability.py::Test_Prompts: *ref_5_83_0
20852107
tests/parametric/test_llm_observability/test_llm_observability_dne.py::Test_Dataset: missing_feature

0 commit comments

Comments
 (0)