Skip to content

Commit f5f89fb

Browse files
chore: activate easy wins for @DataDog/ml-observability
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
1 parent 943fe53 commit f5f89fb

1 file changed

Lines changed: 29 additions & 7 deletions

File tree

manifests/nodejs.yml

Lines changed: 29 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1729,14 +1729,34 @@ manifest:
17291729
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Targeting_Key_Optional: bug (FFL-1730)
17301730
tests/integration_frameworks/llm/anthropic/test_anthropic_apm.py::TestAnthropicApmMessages: *ref_5_71_0
17311731
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages: *ref_5_71_0
1732-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create: missing_feature # ephemeral cache TTL metrics not yet released
1733-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_content_block: missing_feature # ephemeral cache TTL metrics not yet released
1732+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create: # ephemeral cache TTL metrics not yet released
1733+
- weblog_declaration:
1734+
'*': missing_feature
1735+
anthropic-js@0.71.0: '>=5.110.0'
1736+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_content_block: # ephemeral cache TTL metrics not yet released
1737+
- weblog_declaration:
1738+
'*': missing_feature
1739+
anthropic-js@0.71.0: '>=5.110.0'
17341740
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_error: bug (MLOB-1234)
17351741
? tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_multiple_system_prompts
1736-
: missing_feature # ephemeral cache TTL metrics not yet released
1737-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_redact_image_input: missing_feature # ephemeral cache TTL metrics not yet released
1738-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_stream_method: missing_feature # ephemeral cache TTL metrics not yet released
1739-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_tool_result: bug (MLOB-1234)
1742+
: # ephemeral cache TTL metrics not yet released
1743+
- weblog_declaration:
1744+
'*': missing_feature
1745+
anthropic-js@0.71.0: '>=5.110.0'
1746+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_redact_image_input: # ephemeral cache TTL metrics not yet released
1747+
- weblog_declaration:
1748+
'*': missing_feature
1749+
anthropic-js@0.71.0: '>=5.110.0'
1750+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_stream_method: # ephemeral cache TTL metrics not yet released
1751+
- weblog_declaration:
1752+
'*': missing_feature
1753+
anthropic-js@0.71.0: '>=5.110.0'
1754+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_tool_result: # TODO: a lower version might be supported
1755+
- declaration: bug (MLOB-1234)
1756+
component_version: <5.110.0
1757+
weblog: [anthropic-js@0.71.0]
1758+
- declaration: bug (MLOB-1234)
1759+
excluded_weblog: [anthropic-js@0.71.0]
17401760
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_with_tools: missing_feature (Node.js LLM Observability Anthropic integration does not submit tool definitions)
17411761
tests/integration_frameworks/llm/google_genai/test_google_genai_apm.py::TestGoogleGenAiEmbedContent: *ref_5_81_0
17421762
tests/integration_frameworks/llm/google_genai/test_google_genai_apm.py::TestGoogleGenAiGenerateContent: *ref_5_81_0
@@ -2110,7 +2130,9 @@ manifest:
21102130
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_sample_rate_0_TS007: "missing_feature (CSS v1.2.0: dd-trace-js does not drop P0 traces when DD_TRACE_SAMPLE_RATE=0; traces are still emitted with _sampling_priority_v1=-1 instead of being dropped client-side)"
21112131
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_successes_errors_recorded_separately_TS006: "missing_feature (CSS v1.2.0: dd-trace-js groups error and success spans into the same aggregation bucket; ErrorSummary distinct from OkSummary is not produced)"
21122132
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_top_level_TS005: "missing_feature (CSS v1.2.0: dd-trace-js does not produce stats for nested top-level (service-entry) child spans when parent and child are in different services; only the outer span yields a stats entry)"
2113-
tests/parametric/test_llm_observability/test_llm_observability.py::Test_CostTags: missing_feature (cost_tags not yet supported in Node.js LLMObs SDK)
2133+
tests/parametric/test_llm_observability/test_llm_observability.py::Test_CostTags: # TODO: a lower version might be supported
2134+
- declaration: missing_feature (cost_tags not yet supported in Node.js LLMObs SDK)
2135+
component_version: <5.110.0
21142136
tests/parametric/test_llm_observability/test_llm_observability.py::Test_Enablement: *ref_5_66_0
21152137
tests/parametric/test_llm_observability/test_llm_observability.py::Test_Prompts: *ref_5_83_0
21162138
tests/parametric/test_llm_observability/test_llm_observability_dne.py::Test_Dataset: missing_feature

0 commit comments

Comments
 (0)