feat(e2e): MSW cassette layer for hermetic e2e tests #4875
Qardintegration-tests.yaml
on: pull_request
e2e
9m 5s
e2e-canary
17m 46s
Matrix: js-provider-tests
Annotations
32 errors and 6 warnings
|
js-provider-tests (ubuntu-latest, 20)
Process completed with exit code 1.
|
|
src/wrappers/anthropic.test.ts > anthropic client unit tests > test client.message.create with stream=true:
js/src/wrappers/anthropic.test.ts#L392
AssertionError: expected 'shall i compare thee to a summers day…' to contain 'shakespeare'
Expected: "shakespeare"
Received: "shall i compare thee to a summers day thou art more lovely and more temperate rough winds do shake the darling buds of may and summers lease hath all too short a date sometime too hot the eye of heaven shines and often is his gold complexion dimmed and every fair from fair sometime declines by chance or natures changing course untrimmed but thy eternal summer shall not fade nor lose possession of that fair thou owest nor shall death brag thou wanderest in his shade when in eternal lines to time thou growest so long as men can breathe or eyes can see so long lives this and this gives life to thee"
❯ src/wrappers/anthropic.test.ts:392:20
|
|
src/wrappers/anthropic.test.ts > anthropic client unit tests > test client.message.create with stream=true:
js/src/wrappers/anthropic.test.ts#L392
AssertionError: expected 'shall i compare thee to a summers day…' to contain 'shakespeare'
Expected: "shakespeare"
Received: "shall i compare thee to a summers day thou art more lovely and more temperate rough winds do shake the darling buds of may and summers lease hath all too short a date sometime too hot the eye of heaven shines and often is his gold complexion dimmed and every fair from fair sometime declines by chance or natures changing course untrimmed but thy eternal summer shall not fade nor lose possession of that fair thou owest nor shall death brag thou wanderest in his shade when in eternal lines to time thou growest so long as men can breathe or eyes can see so long lives this and this gives life to thee"
❯ src/wrappers/anthropic.test.ts:392:20
|
|
src/wrappers/anthropic.test.ts > anthropic client unit tests > test client.message.create with stream=true:
js/src/wrappers/anthropic.test.ts#L391
AssertionError: expected 'shallicomparetheeatoasummersday thoua…' to contain 'shall i compare thee to a summers day'
Expected: "shall i compare thee to a summers day"
Received: "shallicomparetheeatoasummersday thouartmorelovelyandmoretemperate roughwindsdonshakethedarlingsbudsofmay andsummersleasehathalltooshshortadate sometimestooghottheeeyeofheavenshines andsoftengoldencomplexionisdimmed andeveryfalirfromfairsometimesdeclines bychangeornaturesuntonaturesrimmed butthyeternalsummersshallfadefade norlosepossessionofthatfairethouowest butbeautysbeautyshallfromtheenotfade norshalldeathbragthouwanderestinhishade solong asmencanbreatheoeyescanseee solonglivesthisandthisgiveslifetotheee"
❯ src/wrappers/anthropic.test.ts:391:20
|
|
src/wrappers/anthropic.test.ts > anthropic client unit tests > test client.message.create with stream=true:
js/src/wrappers/anthropic.test.ts#L392
AssertionError: expected 'shall i compare thee to a summers day…' to contain 'shakespeare'
Expected: "shakespeare"
Received: "shall i compare thee to a summers day thou art more lovely and more temperate rough winds do shake the darling buds of may and summers lease hath all too short a date sometime too hot the eye of heaven shines and often is his gold complexion dimmed and every fair from fair sometime declines by chance or natures changing course untrimmed but thy eternal summer shall not fade nor lose possession of that fair thou owest nor shall death brag thou wanderest in his shade when in eternal lines to time thou growest so long as men can breathe or eyes can see so long lives this and this gives life to thee"
❯ src/wrappers/anthropic.test.ts:392:20
|
|
js-provider-tests (ubuntu-latest, 22)
Process completed with exit code 1.
|
|
src/wrappers/anthropic.test.ts > anthropic client unit tests > test client.message.create with stream=true:
js/src/wrappers/anthropic.test.ts#L391
AssertionError: expected 'shallicomparetheeatoasummersday thoua…' to contain 'shall i compare thee to a summers day'
Expected: "shall i compare thee to a summers day"
Received: "shallicomparetheeatoasummersday thouartmorelovelyandmoretemperate roughwindsdonshakethedarlingsbudsofmay andsummersleasehathalltooshshortadate sometimestooghottheeeyeofheavenshines andsoftengoldencomplexionisdimmed andeveryfalirfromfairsometimesdeclines bychangeornaturesforceornaturesrimmed butthyeternalsummersshallfadefade norlosepossessionofthatfairethouowest butbeautyslegacyshallneverbefade inlinestotheethybeautyshallbeshowed solong asmencanbreatheoeyescanseee solonglivesthisandthisgiveslifetotheee"
❯ src/wrappers/anthropic.test.ts:391:20
|
|
src/wrappers/anthropic.test.ts > anthropic client unit tests > test client.message.create with stream=true:
js/src/wrappers/anthropic.test.ts#L392
AssertionError: expected 'shall i compare thee to a summers day…' to contain 'shakespeare'
Expected: "shakespeare"
Received: "shall i compare thee to a summers day thou art more lovely and more temperate rough winds do shake the darling buds of may and summers lease hath all too short a date sometime too hot the eye of heaven shines and often is his gold complexion dimmed and every fair from fair sometime declines by chance or natures changing course untrimmed but thy eternal summer shall not fade nor lose possession of that fair thou owest nor shall death brag thou wanderest in his shade when in eternal lines to time thou growest so long as men can breathe or eyes can see so long lives this and this gives life to thee"
❯ src/wrappers/anthropic.test.ts:392:20
|
|
src/wrappers/anthropic.test.ts > anthropic client unit tests > test client.message.create with stream=true:
js/src/wrappers/anthropic.test.ts#L391
AssertionError: expected 'shallicomparetheeatoasummersday thoua…' to contain 'shall i compare thee to a summers day'
Expected: "shall i compare thee to a summers day"
Received: "shallicomparetheeatoasummersday thouartmorelovelyandmoretemperate roughwindsdonshakethedarlingsbudsofmay andsummersleasehathalltooshshortadate sometimestooghottheeeyeofheavenshines andsoftengoldencomplexionisdimmed andeveryfalirfromfairsometimesdeclines bychangeornaturescoursuntrimmed butthyeternalsummersshallfadefade norlosepossessionofthatfairethouowest butbeautyselftotheeinshallstayade intheeternallinesofthisverse solong asmencanbreatheoeyescanseee solonglivesthisandthisgiveslifetotheee"
❯ src/wrappers/anthropic.test.ts:391:20
|
|
src/wrappers/anthropic.test.ts > anthropic client unit tests > test client.message.create with stream=true:
js/src/wrappers/anthropic.test.ts#L391
AssertionError: expected 'shallicomparetheeatoasummersday thoua…' to contain 'shall i compare thee to a summers day'
Expected: "shall i compare thee to a summers day"
Received: "shallicomparetheeatoasummersday thouartmorelovelyandmoretemperate roughwindsdonshakethedarlingsbudsofmay andsummersleasehathalltooshshortadate sometimestooghottheeeyeofheavenshines andsoftengoldencomplexionisdimmed andeveryfalirfromfairsometimesdeclines bychangeornaturesforceornaturesrimmed butthyeternalsummersshallfadefade norlosepossessionofthatfairethouowest butbeautysbeautyshallfromtheenotfade norshalldeathbragthouwanderestinhishade solong asmencanbreatheoeyescanseee solonglivesthisandthisgiveslifetotheee"
❯ src/wrappers/anthropic.test.ts:391:20
|
|
js-provider-tests (windows-latest, 22)
Process completed with exit code 1.
|
|
src/wrappers/anthropic.test.ts > anthropic client unit tests > test client.message.create with stream=true:
js/src/wrappers/anthropic.test.ts#L392
AssertionError: expected 'shall i compare thee to a summers day…' to contain 'shakespeare'
Expected: "shakespeare"
Received: "shall i compare thee to a summers day thou art more lovely and more temperate rough winds do shake the darling buds of may and summers lease hath all too short a date sometime too hot the eye of heaven shines and often is his gold complexion dimmed and every fair from fair sometime declines by chance or natures changing course untrimmed but thy eternal summer shall not fade nor lose possession of that fair thou owest nor shall death brag thou wanderest in his shade when in eternal lines to time thou growest so long as men can breathe or eyes can see so long lives this and this gives life to thee"
❯ src/wrappers/anthropic.test.ts:392:20
|
|
src/wrappers/anthropic.test.ts > anthropic client unit tests > test client.message.create with stream=true:
js/src/wrappers/anthropic.test.ts#L391
AssertionError: expected 'shallicomparetheeatoasummersday thoua…' to contain 'shall i compare thee to a summers day'
Expected: "shall i compare thee to a summers day"
Received: "shallicomparetheeatoasummersday thouartmorelovelyandmoretemperate roughwindsdonshakethedarlingsbudsofmay andsummersleasehathalltooshshortadate sometimestooghottheeeyeofheavenshines andsoftengoldencomplexionisdimmed andeveryfalirfromfairsometimesdeclines bychangeornaturesforceornaturesrimmed butthyeternalsummersshallfadefade norlosepossessionofthatfairethouowest butbeautysbeautyshallfromtheenotfade norshalldeathbragthouwanderestinhishade solong asmencanbreatheoeyescanseee solonglivesthisandthisgiveslifetotheee"
❯ src/wrappers/anthropic.test.ts:391:20
|
|
src/wrappers/anthropic.test.ts > anthropic client unit tests > test client.message.create with stream=true:
js/src/wrappers/anthropic.test.ts#L392
AssertionError: expected 'shall i compare thee to a summers day…' to contain 'shakespeare'
Expected: "shakespeare"
Received: "shall i compare thee to a summers day thou art more lovely and more temperate rough winds do shake the darling buds of may and summers lease hath all too short a date sometime too hot the eye of heaven shines and often is his gold complexion dimmed and every fair from fair sometime declines by chance or natures changing course untrimmed but thy eternal summer shall not fade nor lose possession of that fair thou owest nor shall death brag thou wanderest in his shade when in eternal lines to time thou growest so long as men can breathe or eyes can see so long lives this and this gives life to thee"
❯ src/wrappers/anthropic.test.ts:392:20
|
|
src/wrappers/anthropic.test.ts > anthropic client unit tests > test client.message.create with stream=true:
js/src/wrappers/anthropic.test.ts#L391
AssertionError: expected 'shallicomparetheeatoasummersday thoua…' to contain 'shall i compare thee to a summers day'
Expected: "shall i compare thee to a summers day"
Received: "shallicomparetheeatoasummersday thouartmorelovelyandmoretemperate roughwindsdonshakethedarlingsbudsofmay andsummersleasehathalltooshshortadate sometimestooghottheeeyeofheavenshines andsoftengoldencomplexionisdimmed andeveryfalirfromfairsometimesdeclines bychangeornaturesforceornaturesrimmed butthyeternalsummersshallfadefade norlosepossessionofthatfairethouowest butbeautyslegacyshallneverbefade inlinestotheethybeautyshallbeshowed solong asmencanbreatheoeyescanseee solonglivesthisandthisgiveslifetotheee"
❯ src/wrappers/anthropic.test.ts:391:20
|
|
js-provider-tests (windows-latest, 20)
Process completed with exit code 1.
|
|
src/wrappers/anthropic.test.ts > anthropic client unit tests > test client.message.create with stream=true:
js/src/wrappers/anthropic.test.ts#L391
AssertionError: expected 'shallicomparetheeatoasummersday thoua…' to contain 'shall i compare thee to a summers day'
Expected: "shall i compare thee to a summers day"
Received: "shallicomparetheeatoasummersday thouartmorelovelyandmoretemperate roughwindsdonshakethedarlingsbudsofmay andsummersleasehathalltooshshortadate sometimestooghottheeeyeofheavenshines andoftenishistgoldencompleximndimmed andeveryfalirfromfairsometimesdeclines bychangeornaturesnaturesricharelrimmed butthyeternalsummersshallfadefade norlosepossessionofthatfaiirthouowest norshalldeathtbragthouwanderstnhissade wheninthyeternallinestotime thoushowest solong asmencanbreatheoeyescanseee solonglivesthisandthisgiveslifetotheee"
❯ src/wrappers/anthropic.test.ts:391:20
|
|
src/wrappers/anthropic.test.ts > anthropic client unit tests > test client.message.create with stream=true:
js/src/wrappers/anthropic.test.ts#L392
AssertionError: expected 'shall i compare thee to a summers day…' to contain 'shakespeare'
Expected: "shakespeare"
Received: "shall i compare thee to a summers day thou art more lovely and more temperate rough winds do shake the darling buds of may and summers lease hath all too short a date sometime too hot the eye of heaven shines and often is his gold complexion dimmed and every fair from fair sometime declines by chance or natures changing course untrimmed but thy eternal summer shall not fade nor lose possession of that fair thou owest nor shall death brag thou wanderest in his shade when in eternal lines to time thou growest so long as men can breathe or eyes can see so long lives this and this gives life to thee"
❯ src/wrappers/anthropic.test.ts:392:20
|
|
src/wrappers/anthropic.test.ts > anthropic client unit tests > test client.message.create with stream=true:
js/src/wrappers/anthropic.test.ts#L392
AssertionError: expected 'shall i compare thee to a summers day…' to contain 'shakespeare'
Expected: "shakespeare"
Received: "shall i compare thee to a summers day thou art more lovely and more temperate rough winds do shake the darling buds of may and summers lease hath all too short a date sometime too hot the eye of heaven shines and often is his gold complexion dimmed and every fair from fair sometime declines by chance or natures changing course untrimmed but thy eternal summer shall not fade nor lose possession of that fair thou owest nor shall death brag thou wanderest in his shade when in eternal lines to time thou growest so long as men can breathe or eyes can see so long lives this and this gives life to thee"
❯ src/wrappers/anthropic.test.ts:392:20
|
|
src/wrappers/anthropic.test.ts > anthropic client unit tests > test client.message.create with stream=true:
js/src/wrappers/anthropic.test.ts#L392
AssertionError: expected 'shall i compare thee to a summers day…' to contain 'shakespeare'
Expected: "shakespeare"
Received: "shall i compare thee to a summers day thou art more lovely and more temperate rough winds do shake the darling buds of may and summers lease hath all too short a date sometime too hot the eye of heaven shines and often is his gold complexion dimmed and every fair from fair sometime declines by chance or natures changing course untrimmed but thy eternal summer shall not fade nor lose possession of that fair thou owest nor shall death brag thou wanderest in his shade when in eternal lines to time thou growest so long as men can breathe or eyes can see so long lives this and this gives life to thee"
❯ src/wrappers/anthropic.test.ts:392:20
|
|
scenarios/google-adk-instrumentation/scenario.test.ts > google adk sdk 0.6.1 > wrapped instrumentation > matches the shared span snapshot:
e2e/scenarios/google-adk-instrumentation/assertions.ts#L288
Error: Snapshot `google adk sdk 0.6.1 > wrapped instrumentation > matches the shared span snapshot 1` mismatched
- Expected
+ Received
@@ -33,37 +33,93 @@
"metadata": {
"google_adk.session_id": "test-session-1",
"google_adk.user_id": "test-user",
"provider": "google-adk"
},
- "metric_keys": [
+ "metric_keys": [],
- "duration"
- ],
- "name": "Google ADK Runner",
+ "name": "Google ADK Runner",
+ "root_span_id": "<span:1>",
+ "span_id": "<span:3>",
+ "span_parents": [
+ "<span:2>"
+ ],
+ "type": "task"
+ },
+ {
+ "has_input": false,
+ "has_output": false,
+ "metadata": {
+ "google_adk.agent_name": "weather_agent",
+ "model": "gemini-2.5-flash-lite",
+ "provider": "google-adk"
+ },
+ "metric_keys": [],
+ "name": "Agent: weather_agent",
"root_span_id": "<span:1>",
- "span_id": "<span:3>",
+ "span_id": "<span:4>",
"span_parents": [
- "<span:2>"
+ "<span:3>"
],
"type": "task"
},
{
- "has_input": false,
- "has_output": false,
- "metadata": {
- "google_adk.agent_name": "weather_agent",
- "model": "gemini-2.5-flash-lite",
- "provider": "google-adk"
- },
- "metric_keys": [
- "duration"
- ],
- "name": "Agent: weather_agent",
- "root_span_id": "<span:1>",
- "span_id": "<span:4>",
- "span_parents": [
- "<span:3>"
+ "has_input": true,
+ "has_output": true,
+ "metadata": {
+ "google_adk.tool_call_id": "adk-<uuid:5>",
+ "google_adk.tool_name": "get_weather",
+ "provider": "google-adk"
+ },
+ "metric_keys": [
+ "duration"
+ ],
+ "name": "tool: get_weather",
+ "root_span_id": "<span:1>",
+ "span_id": "<span:5>",
+ "span_parents": [
+ "<span:4>"
+ ],
+ "type": "tool"
+ },
+ {
+ "has_input": false,
+ "has_output": true,
+ "metadata": {
+ "google_adk.agent_name": "weather_agent",
+ "model": "gemini-2.5-flash-lite",
+ "provider": "google-adk"
+ },
+ "metric_keys": [
+ "duration"
+ ],
+ "name": "Agent: weather_agent",
+ "root_span_id": "<span:1>",
+ "span_id": "<span:4>",
+ "span_parents": [
+ "<span:3>"
+ ],
+ "type": "task"
+ },
+ {
+ "has_input": true,
+ "has_output": true,
+ "metadata": {
+ "google_adk.session_id": "test-session-1",
+ "google_adk.user_id": "test-user",
+ "provider": "google-adk"
+ },
+ "metric_keys": [
+ "completion_tokens",
+ "duration",
+ "prompt_tokens",
+ "tokens"
+ ],
+ "name": "Google ADK Runner",
+ "root_span_id": "<span:1>",
+ "span_id": "<span:3>",
+ "span_parents": [
+ "<span:2>"
],
"type": "task"
}
]
❯ scenarios/google-adk-instrumentation/assertions.ts:288:7
|
|
scenarios/google-adk-instrumentation/scenario.test.ts > google adk sdk 0.6.1 > wrapped instrumentation > matches the shared span snapshot:
e2e/scenarios/google-adk-instrumentation/assertions.ts#L288
Error: Snapshot `google adk sdk 0.6.1 > wrapped instrumentation > matches the shared span snapshot 1` mismatched
- Expected
+ Received
@@ -33,37 +33,93 @@
"metadata": {
"google_adk.session_id": "test-session-1",
"google_adk.user_id": "test-user",
"provider": "google-adk"
},
- "metric_keys": [
+ "metric_keys": [],
- "duration"
- ],
- "name": "Google ADK Runner",
+ "name": "Google ADK Runner",
+ "root_span_id": "<span:1>",
+ "span_id": "<span:3>",
+ "span_parents": [
+ "<span:2>"
+ ],
+ "type": "task"
+ },
+ {
+ "has_input": false,
+ "has_output": false,
+ "metadata": {
+ "google_adk.agent_name": "weather_agent",
+ "model": "gemini-2.5-flash-lite",
+ "provider": "google-adk"
+ },
+ "metric_keys": [],
+ "name": "Agent: weather_agent",
"root_span_id": "<span:1>",
- "span_id": "<span:3>",
+ "span_id": "<span:4>",
"span_parents": [
- "<span:2>"
+ "<span:3>"
],
"type": "task"
},
{
- "has_input": false,
- "has_output": false,
- "metadata": {
- "google_adk.agent_name": "weather_agent",
- "model": "gemini-2.5-flash-lite",
- "provider": "google-adk"
- },
- "metric_keys": [
- "duration"
- ],
- "name": "Agent: weather_agent",
- "root_span_id": "<span:1>",
- "span_id": "<span:4>",
- "span_parents": [
- "<span:3>"
+ "has_input": true,
+ "has_output": true,
+ "metadata": {
+ "google_adk.tool_call_id": "adk-<uuid:5>",
+ "google_adk.tool_name": "get_weather",
+ "provider": "google-adk"
+ },
+ "metric_keys": [
+ "duration"
+ ],
+ "name": "tool: get_weather",
+ "root_span_id": "<span:1>",
+ "span_id": "<span:5>",
+ "span_parents": [
+ "<span:4>"
+ ],
+ "type": "tool"
+ },
+ {
+ "has_input": false,
+ "has_output": true,
+ "metadata": {
+ "google_adk.agent_name": "weather_agent",
+ "model": "gemini-2.5-flash-lite",
+ "provider": "google-adk"
+ },
+ "metric_keys": [
+ "duration"
+ ],
+ "name": "Agent: weather_agent",
+ "root_span_id": "<span:1>",
+ "span_id": "<span:4>",
+ "span_parents": [
+ "<span:3>"
+ ],
+ "type": "task"
+ },
+ {
+ "has_input": true,
+ "has_output": true,
+ "metadata": {
+ "google_adk.session_id": "test-session-1",
+ "google_adk.user_id": "test-user",
+ "provider": "google-adk"
+ },
+ "metric_keys": [
+ "completion_tokens",
+ "duration",
+ "prompt_tokens",
+ "tokens"
+ ],
+ "name": "Google ADK Runner",
+ "root_span_id": "<span:1>",
+ "span_id": "<span:3>",
+ "span_parents": [
+ "<span:2>"
],
"type": "task"
}
]
❯ scenarios/google-adk-instrumentation/assertions.ts:288:7
|
|
scenarios/cohere-instrumentation/scenario.test.ts > cohere sdk 8.0.0 > auto-hook instrumentation:
e2e/helpers/scenario-harness.ts#L488
Error: Scenario /home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/scenario.mjs failed with exit code 1
STDOUT:
STDERR:
TooManyRequestsError: TooManyRequestsError
Status code: 429
Body: {
"id": "3174a060-b590-42c3-aa52-959d8bc5f992",
"message": "You are past the per-minute request limit for this model, please wait and try again later."
}
at V2Client.<anonymous> (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@8.0.0_@aws-crypto+sha256-js@5.2.0_@aws-sdk+credential-providers@3.1028.0_@smi_3c0e0b28ba619f4d228bdc6609f3a04e/node_modules/cohere-ai/api/resources/v2/client/Client.js:211:19)
at Generator.next (<anonymous>)
at fulfilled (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@8.0.0_@aws-crypto+sha256-js@5.2.0_@aws-sdk+credential-providers@3.1028.0_@smi_3c0e0b28ba619f4d228bdc6609f3a04e/node_modules/cohere-ai/api/resources/v2/client/Client.js:59:24)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5) {
statusCode: 429,
body: {
id: '3174a060-b590-42c3-aa52-959d8bc5f992',
message: 'You are past the per-minute request limit for this model, please wait and try again later.'
},
rawResponse: {
headers: Headers {
'access-control-expose-headers': 'X-Debug-Trace-ID',
'cache-control': 'no-cache, no-store, no-transform, must-revalidate, private, max-age=0',
'content-encoding': 'gzip',
'content-type': 'application/json',
expires: 'Thu, 01 Jan 1970 00:00:00 GMT',
pragma: 'no-cache',
vary: 'Origin,Accept-Encoding',
'x-accel-expires': '0',
'x-debug-trace-id': '1165330af346ab59cb82beb406da0c19',
date: 'Fri, 01 May 2026 21:33:57 GMT',
'x-envoy-upstream-service-time': '5',
server: 'envoy',
via: '1.1 google',
'alt-svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000',
'transfer-encoding': 'chunked'
},
redirected: false,
status: 429,
statusText: 'Too Many Requests',
type: 'basic',
url: 'https://api.cohere.com/v2/chat'
}
}
❯ V2Client.<anonymous> .bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@8.0.0_@aws-crypto+sha256-js@5.2.0_@aws-sdk+credential-providers@3.1028.0_@smi_3c0e0b28ba619f4d228bdc6609f3a04e/node_modules/cohere-ai/api/resources/v2/client/Client.js:211:19
❯ fulfilled .bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@8.0.0_@aws-crypto+sha256-js@5.2.0_@aws-sdk+credential-providers@3.1028.0_@smi_3c0e0b28ba619f4d228bdc6609f3a04e/node_modules/cohere-ai/api/resources/v2/client/Client.js:59:24
❯ runScenarioDirOrThrow helpers/scenario-harness.ts:488:11
❯ runNodeScenarioDir helpers/scenario-harness.ts:521:10
❯ runWithContext helpers/scenario-harness.ts:674:20
❯ Object.runScenario scenarios/cohere-instrumentation/scenario.test.ts:59:9
❯ scenarios/cohere-instrumentation/assertions.ts:116:9
❯ withScenarioHarness helpers/scenario-harness.ts:687:5
❯ scenarios/cohere-instrumentation/assertions.ts:115:7
|
|
scenarios/cohere-instrumentation/scenario.test.ts > cohere sdk 8.0.0 > wrapped instrumentation:
e2e/helpers/scenario-harness.ts#L488
Error: Scenario /home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/scenario.ts failed with exit code 1
STDOUT:
STDERR:
TooManyRequestsError: TooManyRequestsError
Status code: 429
Body: {
"id": "a3e660c2-0b24-4081-8822-0b50b54daa10",
"message": "You are past the per-minute request limit for this model, please wait and try again later."
}
at V2Client.<anonymous> (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@8.0.0_@aws-crypto+sha256-js@5.2.0_@aws-sdk+credential-providers@3.1028.0_@smi_3c0e0b28ba619f4d228bdc6609f3a04e/node_modules/cohere-ai/api/resources/v2/client/Client.js:126:31)
at Generator.next (<anonymous>)
at fulfilled (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@8.0.0_@aws-crypto+sha256-js@5.2.0_@aws-sdk+credential-providers@3.1028.0_@smi_3c0e0b28ba619f4d228bdc6609f3a04e/node_modules/cohere-ai/api/resources/v2/client/Client.js:39:58)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5) {
statusCode: 429,
body: {
id: 'a3e660c2-0b24-4081-8822-0b50b54daa10',
message: 'You are past the per-minute request limit for this model, please wait and try again later.'
},
rawResponse: {
headers: Headers {
'access-control-expose-headers': 'X-Debug-Trace-ID',
'cache-control': 'no-cache, no-store, no-transform, must-revalidate, private, max-age=0',
'content-encoding': 'gzip',
'content-type': 'application/json',
expires: 'Thu, 01 Jan 1970 00:00:00 GMT',
pragma: 'no-cache',
vary: 'Origin,Accept-Encoding',
'x-accel-expires': '0',
'x-debug-trace-id': 'be82ab4e4b77f05104e4b813c1f12f5d',
date: 'Fri, 01 May 2026 21:33:52 GMT',
'x-envoy-upstream-service-time': '5',
server: 'envoy',
via: '1.1 google',
'alt-svc': 'h3=":443"; ma=2592000',
'transfer-encoding': 'chunked'
},
redirected: false,
status: 429,
statusText: 'Too Many Requests',
type: 'basic',
url: 'https://api.cohere.com/v2/chat'
}
}
❯ V2Client.<anonymous> .bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@8.0.0_@aws-crypto+sha256-js@5.2.0_@aws-sdk+credential-providers@3.1028.0_@smi_3c0e0b28ba619f4d228bdc6609f3a04e/node_modules/cohere-ai/api/resources/v2/client/Client.js:126:31
❯ fulfilled .bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@8.0.0_@aws-crypto+sha256-js@5.2.0_@aws-sdk+credential-providers@3.1028.0_@smi_3c0e0b28ba619f4d228bdc6609f3a04e/node_modules/cohere-ai/api/resources/v2/client/Client.js:39:58
❯ runScenarioDirOrThrow helpers/scenario-harness.ts:488:11
❯ runScenarioDir helpers/scenario-harness.ts:507:10
❯ runWithContext helpers/scenario-harness.ts:674:20
❯ Object.runScenario scenarios/cohere-instrumentation/scenario.test.ts:37:9
❯ scenarios/cohere-instrumentation/assertions.ts:116:9
❯ withScenarioHarness helpers/scenario-harness.ts:687:5
❯ scenarios/cohere-instrumentation/assertions.ts:115:7
|
|
scenarios/cohere-instrumentation/scenario.test.ts > cohere sdk 7.21.0 > auto-hook instrumentation:
e2e/helpers/scenario-harness.ts#L488
Error: Scenario /home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/scenario.cohere-v7.mjs failed with exit code 1
STDOUT:
STDERR:
TooManyRequestsError: TooManyRequestsError
Status code: 429
Body: {
"id": "210e7ee8-f4f0-4fc8-8376-e721bed0fff1",
"message": "You are past the per-month request limit for this model, please wait and try again later."
}
at V2Client.<anonymous> (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:211:19)
at Generator.next (<anonymous>)
at fulfilled (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:59:24)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5) {
statusCode: 429,
body: {
id: '210e7ee8-f4f0-4fc8-8376-e721bed0fff1',
message: 'You are past the per-month request limit for this model, please wait and try again later.'
},
rawResponse: {
headers: Headers {
'access-control-expose-headers': 'X-Debug-Trace-ID',
'cache-control': 'no-cache, no-store, no-transform, must-revalidate, private, max-age=0',
'content-encoding': 'gzip',
'content-type': 'application/json',
expires: 'Thu, 01 Jan 1970 00:00:00 GMT',
pragma: 'no-cache',
vary: 'Origin,Accept-Encoding',
'x-accel-expires': '0',
'x-debug-trace-id': 'be22a05cba192e317bcca754b3a05f9c',
date: 'Fri, 01 May 2026 21:33:47 GMT',
'x-envoy-upstream-service-time': '8',
server: 'envoy',
via: '1.1 google',
'alt-svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000',
'transfer-encoding': 'chunked'
},
redirected: false,
status: 429,
statusText: 'Too Many Requests',
type: 'basic',
url: 'https://api.cohere.com/v2/chat'
}
}
❯ V2Client.<anonymous> .bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:211:19
❯ fulfilled .bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:59:24
❯ runScenarioDirOrThrow helpers/scenario-harness.ts:488:11
❯ runNodeScenarioDir helpers/scenario-harness.ts:521:10
❯ runWithContext helpers/scenario-harness.ts:674:20
❯ Object.runScenario scenarios/cohere-instrumentation/scenario.test.ts:59:9
❯ scenarios/cohere-instrumentation/assertions.ts:116:9
❯ withScenarioHarness helpers/scenario-harness.ts:687:5
❯ scenarios/cohere-instrumentation/assertions.ts:115:7
|
|
scenarios/cohere-instrumentation/scenario.test.ts > cohere sdk 7.21.0 > wrapped instrumentation:
e2e/helpers/scenario-harness.ts#L488
Error: Scenario /home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/scenario.cohere-v7.ts failed with exit code 1
STDOUT:
STDERR:
TooManyRequestsError: TooManyRequestsError
Status code: 429
Body: {
"id": "105adee1-d5e5-4178-86f3-50da633c2599",
"message": "You are past the per-month request limit for this model, please wait and try again later."
}
at V2Client.<anonymous> (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:126:31)
at Generator.next (<anonymous>)
at fulfilled (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:39:58)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5) {
statusCode: 429,
body: {
id: '105adee1-d5e5-4178-86f3-50da633c2599',
message: 'You are past the per-month request limit for this model, please wait and try again later.'
},
rawResponse: {
headers: Headers {
'access-control-expose-headers': 'X-Debug-Trace-ID',
'cache-control': 'no-cache, no-store, no-transform, must-revalidate, private, max-age=0',
'content-encoding': 'gzip',
'content-type': 'application/json',
expires: 'Thu, 01 Jan 1970 00:00:00 GMT',
pragma: 'no-cache',
vary: 'Origin,Accept-Encoding',
'x-accel-expires': '0',
'x-debug-trace-id': '9ccf22bba2462262e4432810d58fac5e',
date: 'Fri, 01 May 2026 21:33:42 GMT',
'x-envoy-upstream-service-time': '5',
server: 'envoy',
via: '1.1 google',
'alt-svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000',
'transfer-encoding': 'chunked'
},
redirected: false,
status: 429,
statusText: 'Too Many Requests',
type: 'basic',
url: 'https://api.cohere.com/v2/chat'
}
}
❯ V2Client.<anonymous> .bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:126:31
❯ fulfilled .bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:39:58
❯ runScenarioDirOrThrow helpers/scenario-harness.ts:488:11
❯ runScenarioDir helpers/scenario-harness.ts:507:10
❯ runWithContext helpers/scenario-harness.ts:674:20
❯ Object.runScenario scenarios/cohere-instrumentation/scenario.test.ts:37:9
❯ scenarios/cohere-instrumentation/assertions.ts:116:9
❯ withScenarioHarness helpers/scenario-harness.ts:687:5
❯ scenarios/cohere-instrumentation/assertions.ts:115:7
|
|
scenarios/cohere-instrumentation/scenario.test.ts > cohere sdk 7.21.0 > auto-hook instrumentation:
e2e/helpers/scenario-harness.ts#L488
Error: Scenario /home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/scenario.cohere-v7.mjs failed with exit code 1
STDOUT:
STDERR:
TooManyRequestsError: TooManyRequestsError
Status code: 429
Body: {
"id": "5b3da9e2-9bb5-45d0-b25c-7166264cdc88",
"message": "You are past the per-month request limit for this model, please wait and try again later."
}
at V2Client.<anonymous> (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:211:19)
at Generator.next (<anonymous>)
at fulfilled (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:59:24)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5) {
statusCode: 429,
body: {
id: '5b3da9e2-9bb5-45d0-b25c-7166264cdc88',
message: 'You are past the per-month request limit for this model, please wait and try again later.'
},
rawResponse: {
headers: Headers {
'access-control-expose-headers': 'X-Debug-Trace-ID',
'cache-control': 'no-cache, no-store, no-transform, must-revalidate, private, max-age=0',
'content-encoding': 'gzip',
'content-type': 'application/json',
expires: 'Thu, 01 Jan 1970 00:00:00 GMT',
pragma: 'no-cache',
vary: 'Origin,Accept-Encoding',
'x-accel-expires': '0',
'x-debug-trace-id': '031ab636e5383e6435e9b4cbf7eb2592',
date: 'Fri, 01 May 2026 21:33:37 GMT',
'x-envoy-upstream-service-time': '6',
server: 'envoy',
via: '1.1 google',
'alt-svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000',
'transfer-encoding': 'chunked'
},
redirected: false,
status: 429,
statusText: 'Too Many Requests',
type: 'basic',
url: 'https://api.cohere.com/v2/chat'
}
}
❯ V2Client.<anonymous> .bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:211:19
❯ fulfilled .bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:59:24
❯ runScenarioDirOrThrow helpers/scenario-harness.ts:488:11
❯ runNodeScenarioDir helpers/scenario-harness.ts:521:10
❯ runWithContext helpers/scenario-harness.ts:674:20
❯ Object.runScenario scenarios/cohere-instrumentation/scenario.test.ts:59:9
❯ scenarios/cohere-instrumentation/assertions.ts:116:9
❯ withScenarioHarness helpers/scenario-harness.ts:687:5
❯ scenarios/cohere-instrumentation/assertions.ts:115:7
|
|
scenarios/cohere-instrumentation/scenario.test.ts > cohere sdk 7.21.0 > wrapped instrumentation:
e2e/helpers/scenario-harness.ts#L488
Error: Scenario /home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/scenario.cohere-v7.ts failed with exit code 1
STDOUT:
STDERR:
TooManyRequestsError: TooManyRequestsError
Status code: 429
Body: {
"id": "44f4702d-b9e3-4f3f-9f7e-5cd5128acc7d",
"message": "You are past the per-month request limit for this model, please wait and try again later."
}
at V2Client.<anonymous> (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:126:31)
at Generator.next (<anonymous>)
at fulfilled (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:39:58)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5) {
statusCode: 429,
body: {
id: '44f4702d-b9e3-4f3f-9f7e-5cd5128acc7d',
message: 'You are past the per-month request limit for this model, please wait and try again later.'
},
rawResponse: {
headers: Headers {
'access-control-expose-headers': 'X-Debug-Trace-ID',
'cache-control': 'no-cache, no-store, no-transform, must-revalidate, private, max-age=0',
'content-encoding': 'gzip',
'content-type': 'application/json',
expires: 'Thu, 01 Jan 1970 00:00:00 GMT',
pragma: 'no-cache',
vary: 'Origin,Accept-Encoding',
'x-accel-expires': '0',
'x-debug-trace-id': 'b72461da642efc7907691759d6f5ca55',
date: 'Fri, 01 May 2026 21:33:27 GMT',
'x-envoy-upstream-service-time': '5',
server: 'envoy',
via: '1.1 google',
'alt-svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000',
'transfer-encoding': 'chunked'
},
redirected: false,
status: 429,
statusText: 'Too Many Requests',
type: 'basic',
url: 'https://api.cohere.com/v2/chat'
}
}
❯ V2Client.<anonymous> .bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:126:31
❯ fulfilled .bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:39:58
❯ runScenarioDirOrThrow helpers/scenario-harness.ts:488:11
❯ runScenarioDir helpers/scenario-harness.ts:507:10
❯ runWithContext helpers/scenario-harness.ts:674:20
❯ Object.runScenario scenarios/cohere-instrumentation/scenario.test.ts:37:9
❯ scenarios/cohere-instrumentation/assertions.ts:116:9
❯ withScenarioHarness helpers/scenario-harness.ts:687:5
❯ scenarios/cohere-instrumentation/assertions.ts:115:7
|
|
scenarios/cohere-instrumentation/scenario.test.ts > cohere sdk 7.20.0 > auto-hook instrumentation:
e2e/helpers/scenario-harness.ts#L488
Error: Scenario /home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/scenario.cohere-v7.mjs failed with exit code 1
STDOUT:
STDERR:
TooManyRequestsError: TooManyRequestsError
Status code: 429
Body: {
"id": "41180618-88d8-4ead-b1af-79eaf6e6635a",
"message": "You are past the per-month request limit for this model, please wait and try again later."
}
at V2Client.<anonymous> (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:211:19)
at Generator.next (<anonymous>)
at fulfilled (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:59:24)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5) {
statusCode: 429,
body: {
id: '41180618-88d8-4ead-b1af-79eaf6e6635a',
message: 'You are past the per-month request limit for this model, please wait and try again later.'
},
rawResponse: {
headers: Headers {
'access-control-expose-headers': 'X-Debug-Trace-ID',
'cache-control': 'no-cache, no-store, no-transform, must-revalidate, private, max-age=0',
'content-encoding': 'gzip',
'content-type': 'application/json',
expires: 'Thu, 01 Jan 1970 00:00:00 GMT',
pragma: 'no-cache',
vary: 'Origin,Accept-Encoding',
'x-accel-expires': '0',
'x-debug-trace-id': 'd1466753de6ef45c88dbdce322b25a5d',
date: 'Fri, 01 May 2026 21:33:21 GMT',
'x-envoy-upstream-service-time': '5',
server: 'envoy',
via: '1.1 google',
'alt-svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000',
'transfer-encoding': 'chunked'
},
redirected: false,
status: 429,
statusText: 'Too Many Requests',
type: 'basic',
url: 'https://api.cohere.com/v2/chat'
}
}
❯ V2Client.<anonymous> .bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:211:19
❯ fulfilled .bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:59:24
❯ runScenarioDirOrThrow helpers/scenario-harness.ts:488:11
❯ runNodeScenarioDir helpers/scenario-harness.ts:521:10
❯ runWithContext helpers/scenario-harness.ts:674:20
❯ Object.runScenario scenarios/cohere-instrumentation/scenario.test.ts:59:9
❯ scenarios/cohere-instrumentation/assertions.ts:116:9
❯ withScenarioHarness helpers/scenario-harness.ts:687:5
❯ scenarios/cohere-instrumentation/assertions.ts:115:7
|
|
scenarios/cohere-instrumentation/scenario.test.ts > cohere sdk 7.20.0 > wrapped instrumentation:
e2e/helpers/scenario-harness.ts#L488
Error: Scenario /home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/scenario.cohere-v7.ts failed with exit code 1
STDOUT:
STDERR:
TooManyRequestsError: TooManyRequestsError
Status code: 429
Body: {
"id": "cd8c2de6-6e2a-4010-89df-6908b944fd6d",
"message": "You are past the per-month request limit for this model, please wait and try again later."
}
at V2Client.<anonymous> (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:126:31)
at Generator.next (<anonymous>)
at fulfilled (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:39:58)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5) {
statusCode: 429,
body: {
id: 'cd8c2de6-6e2a-4010-89df-6908b944fd6d',
message: 'You are past the per-month request limit for this model, please wait and try again later.'
},
rawResponse: {
headers: Headers {
'access-control-expose-headers': 'X-Debug-Trace-ID',
'cache-control': 'no-cache, no-store, no-transform, must-revalidate, private, max-age=0',
'content-encoding': 'gzip',
'content-type': 'application/json',
expires: 'Thu, 01 Jan 1970 00:00:00 GMT',
pragma: 'no-cache',
vary: 'Origin,Accept-Encoding',
'x-accel-expires': '0',
'x-debug-trace-id': '8477e507926132c2a020371d18a4a484',
date: 'Fri, 01 May 2026 21:33:16 GMT',
'x-envoy-upstream-service-time': '5',
server: 'envoy',
via: '1.1 google',
'alt-svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000',
'transfer-encoding': 'chunked'
},
redirected: false,
status: 429,
statusText: 'Too Many Requests',
type: 'basic',
url: 'https://api.cohere.com/v2/chat'
}
}
❯ V2Client.<anonymous> .bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:126:31
❯ fulfilled .bt-tmp/run-fP4nYZ/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:39:58
❯ runScenarioDirOrThrow helpers/scenario-harness.ts:488:11
❯ runScenarioDir helpers/scenario-harness.ts:507:10
❯ runWithContext helpers/scenario-harness.ts:674:20
❯ Object.runScenario scenarios/cohere-instrumentation/scenario.test.ts:37:9
❯ scenarios/cohere-instrumentation/assertions.ts:116:9
❯ withScenarioHarness helpers/scenario-harness.ts:687:5
❯ scenarios/cohere-instrumentation/assertions.ts:115:7
|
|
e2e-canary
Process completed with exit code 1.
|
|
e2e-canary
@braintrust/js-e2e-tests#test:e2e:canary: command (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e) /home/runner/setup-pnpm/node_modules/.bin/pnpm run test:e2e:canary exited (1)
|
|
js-provider-tests (ubuntu-latest, 20)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5, actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
js-provider-tests (ubuntu-latest, 22)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5, actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
js-provider-tests (windows-latest, 22)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5, actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
js-provider-tests (windows-latest, 20)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5, actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
e2e
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5, actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
e2e-canary
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5, actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|