Skip to content

Commit f6cfb05

Browse files
chore: activate easy wins for @DataDog/ml-observability
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
1 parent 173e293 commit f6cfb05

1 file changed

Lines changed: 29 additions & 7 deletions

File tree

manifests/nodejs.yml

Lines changed: 29 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1671,14 +1671,34 @@ manifest:
16711671
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Targeting_Key_Optional: irrelevant (JS SDK requires targeting key)
16721672
tests/integration_frameworks/llm/anthropic/test_anthropic_apm.py::TestAnthropicApmMessages: *ref_5_71_0
16731673
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages: *ref_5_71_0
1674-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create: missing_feature # ephemeral cache TTL metrics not yet released
1675-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_content_block: missing_feature # ephemeral cache TTL metrics not yet released
1674+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create: # ephemeral cache TTL metrics not yet released
1675+
- weblog_declaration:
1676+
'*': missing_feature
1677+
anthropic-js@0.71.0: '>=5.103.0'
1678+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_content_block: # ephemeral cache TTL metrics not yet released
1679+
- weblog_declaration:
1680+
'*': missing_feature
1681+
anthropic-js@0.71.0: '>=5.103.0'
16761682
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_error: bug (MLOB-1234)
16771683
? tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_multiple_system_prompts
1678-
: missing_feature # ephemeral cache TTL metrics not yet released
1679-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_redact_image_input: missing_feature # ephemeral cache TTL metrics not yet released
1680-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_stream_method: missing_feature # ephemeral cache TTL metrics not yet released
1681-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_tool_result: bug (MLOB-1234)
1684+
: # ephemeral cache TTL metrics not yet released
1685+
- weblog_declaration:
1686+
'*': missing_feature
1687+
anthropic-js@0.71.0: '>=5.103.0'
1688+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_redact_image_input: # ephemeral cache TTL metrics not yet released
1689+
- weblog_declaration:
1690+
'*': missing_feature
1691+
anthropic-js@0.71.0: '>=5.103.0'
1692+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_stream_method: # ephemeral cache TTL metrics not yet released
1693+
- weblog_declaration:
1694+
'*': missing_feature
1695+
anthropic-js@0.71.0: '>=5.103.0'
1696+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_tool_result: # TODO: a lower version might be supported
1697+
- declaration: bug (MLOB-1234)
1698+
component_version: <5.103.0
1699+
weblog: [anthropic-js@0.71.0]
1700+
- declaration: bug (MLOB-1234)
1701+
excluded_weblog: [anthropic-js@0.71.0]
16821702
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_with_tools: missing_feature (Node.js LLM Observability Anthropic integration does not submit tool definitions)
16831703
tests/integration_frameworks/llm/google_genai/test_google_genai_apm.py::TestGoogleGenAiEmbedContent: *ref_5_81_0
16841704
tests/integration_frameworks/llm/google_genai/test_google_genai_apm.py::TestGoogleGenAiGenerateContent: *ref_5_81_0
@@ -2044,7 +2064,9 @@ manifest:
20442064
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_sample_rate_0_TS007: missing_feature (nodejs has not implemented stats computation yet)
20452065
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_successes_errors_recorded_separately_TS006: missing_feature (nodejs has not implemented stats computation yet)
20462066
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_top_level_TS005: missing_feature (nodejs has not implemented stats computation yet)
2047-
tests/parametric/test_llm_observability/test_llm_observability.py::Test_CostTags: missing_feature (cost_tags not yet supported in Node.js LLMObs SDK)
2067+
tests/parametric/test_llm_observability/test_llm_observability.py::Test_CostTags: # TODO: a lower version might be supported
2068+
- declaration: missing_feature (cost_tags not yet supported in Node.js LLMObs SDK)
2069+
component_version: <5.103.0
20482070
tests/parametric/test_llm_observability/test_llm_observability.py::Test_Enablement: *ref_5_66_0
20492071
tests/parametric/test_llm_observability/test_llm_observability.py::Test_Prompts: *ref_5_83_0
20502072
tests/parametric/test_llm_observability/test_llm_observability_dne.py::Test_Dataset: missing_feature

0 commit comments

Comments
 (0)