feat: Add auto and wrapper instrumentation for @github/copilot-sdk #4885
Qardintegration-tests.yaml
on: pull_request
e2e
8m 21s
e2e-canary
10m 11s
Matrix: js-provider-tests
Annotations
12 errors and 6 warnings
|
scenarios/github-copilot-instrumentation/scenario.test.ts > github copilot sdk 0.3.0 > auto-hook instrumentation:
e2e/helpers/scenario-harness.ts#L318
Error: Scenario /home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-iMLUwz/scenarios/github-copilot-instrumentation/scenario.mjs failed with exit code 1
STDOUT:
STDERR:
node:internal/modules/run_main:107
triggerUncaughtException(
^
Error [ERR_MODULE_NOT_FOUND]: Cannot find package 'vscode-jsonrpc' imported from /home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-iMLUwz/scenarios/github-copilot-instrumentation/node_modules/.pnpm/@github+copilot-sdk@0.3.0/node_modules/@github/copilot-sdk/dist/client.js
at Object.getPackageJSONURL (node:internal/modules/package_json_reader:301:9)
at packageResolve (node:internal/modules/esm/resolve:764:81)
at moduleResolve (node:internal/modules/esm/resolve:855:18)
at defaultResolve (node:internal/modules/esm/resolve:988:11)
at nextResolve (node:internal/modules/esm/hooks:785:28)
at resolve (file:///home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/js/dist/auto-instrumentations/loader/esm-hook.mjs:23:21)
at nextResolve (node:internal/modules/esm/hooks:785:28)
at AsyncLoaderHooksOnLoaderHookWorker.resolve (node:internal/modules/esm/hooks:269:30)
at MessagePort.handleMessage (node:internal/modules/esm/worker:251:24)
at [nodejs.internal.kHybridDispatch] (node:internal/event_target:843:20) {
code: 'ERR_MODULE_NOT_FOUND'
}
Node.js v24.15.0
❯ resolve ../js/dist/auto-instrumentations/loader/esm-hook.mjs:23:21
❯ runScenarioDirOrThrow helpers/scenario-harness.ts:318:11
❯ runNodeScenarioDir helpers/scenario-harness.ts:351:10
❯ runWithContext helpers/scenario-harness.ts:453:20
❯ Object.runScenario scenarios/github-copilot-instrumentation/scenario.test.ts:37:7
❯ scenarios/github-copilot-instrumentation/assertions.ts:146:9
❯ withScenarioHarness helpers/scenario-harness.ts:466:5
❯ scenarios/github-copilot-instrumentation/assertions.ts:145:7
|
|
scenarios/cohere-instrumentation/scenario.test.ts > cohere sdk 8.0.0 > auto-hook instrumentation:
e2e/helpers/scenario-harness.ts#L318
Error: Scenario /home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/scenario.mjs failed with exit code 1
STDOUT:
STDERR:
TooManyRequestsError: TooManyRequestsError
Status code: 429
Body: {
"id": "1de1a57a-8ae2-4793-b3a6-e6c351d69646",
"message": "You are past the per-minute request limit for this model, please wait and try again later."
}
at V2Client.<anonymous> (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@8.0.0_@aws-crypto+sha256-js@5.2.0_@aws-sdk+credential-providers@3.1028.0_@smi_3c0e0b28ba619f4d228bdc6609f3a04e/node_modules/cohere-ai/api/resources/v2/client/Client.js:211:19)
at Generator.next (<anonymous>)
at fulfilled (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@8.0.0_@aws-crypto+sha256-js@5.2.0_@aws-sdk+credential-providers@3.1028.0_@smi_3c0e0b28ba619f4d228bdc6609f3a04e/node_modules/cohere-ai/api/resources/v2/client/Client.js:59:24)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5) {
statusCode: 429,
body: {
id: '1de1a57a-8ae2-4793-b3a6-e6c351d69646',
message: 'You are past the per-minute request limit for this model, please wait and try again later.'
},
rawResponse: {
headers: Headers {
'access-control-expose-headers': 'X-Debug-Trace-ID',
'cache-control': 'no-cache, no-store, no-transform, must-revalidate, private, max-age=0',
'content-encoding': 'gzip',
'content-type': 'application/json',
expires: 'Thu, 01 Jan 1970 00:00:00 GMT',
pragma: 'no-cache',
vary: 'Origin,Accept-Encoding',
'x-accel-expires': '0',
'x-debug-trace-id': 'ffbc15829f6e017fe9d890207a802574',
date: 'Sat, 02 May 2026 20:52:54 GMT',
'x-envoy-upstream-service-time': '4',
server: 'envoy',
via: '1.1 google',
'alt-svc': 'h3=":443"; ma=2592000',
'transfer-encoding': 'chunked'
},
redirected: false,
status: 429,
statusText: 'Too Many Requests',
type: 'basic',
url: 'https://api.cohere.com/v2/chat'
}
}
❯ V2Client.<anonymous> .bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@8.0.0_@aws-crypto+sha256-js@5.2.0_@aws-sdk+credential-providers@3.1028.0_@smi_3c0e0b28ba619f4d228bdc6609f3a04e/node_modules/cohere-ai/api/resources/v2/client/Client.js:211:19
❯ fulfilled .bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@8.0.0_@aws-crypto+sha256-js@5.2.0_@aws-sdk+credential-providers@3.1028.0_@smi_3c0e0b28ba619f4d228bdc6609f3a04e/node_modules/cohere-ai/api/resources/v2/client/Client.js:59:24
❯ runScenarioDirOrThrow helpers/scenario-harness.ts:318:11
❯ runNodeScenarioDir helpers/scenario-harness.ts:351:10
❯ runWithContext helpers/scenario-harness.ts:453:20
❯ Object.runScenario scenarios/cohere-instrumentation/scenario.test.ts:53:9
❯ scenarios/cohere-instrumentation/assertions.ts:116:9
❯ withScenarioHarness helpers/scenario-harness.ts:466:5
❯ scenarios/cohere-instrumentation/assertions.ts:115:7
|
|
scenarios/cohere-instrumentation/scenario.test.ts > cohere sdk 8.0.0 > wrapped instrumentation:
e2e/helpers/scenario-harness.ts#L318
Error: Scenario /home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/scenario.ts failed with exit code 1
STDOUT:
STDERR:
TooManyRequestsError: TooManyRequestsError
Status code: 429
Body: {
"id": "db589f08-523b-4081-ba1c-b62241c93fa0",
"message": "You are past the per-minute request limit for this model, please wait and try again later."
}
at V2Client.<anonymous> (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@8.0.0_@aws-crypto+sha256-js@5.2.0_@aws-sdk+credential-providers@3.1028.0_@smi_3c0e0b28ba619f4d228bdc6609f3a04e/node_modules/cohere-ai/api/resources/v2/client/Client.js:126:31)
at Generator.next (<anonymous>)
at fulfilled (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@8.0.0_@aws-crypto+sha256-js@5.2.0_@aws-sdk+credential-providers@3.1028.0_@smi_3c0e0b28ba619f4d228bdc6609f3a04e/node_modules/cohere-ai/api/resources/v2/client/Client.js:39:58)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5) {
statusCode: 429,
body: {
id: 'db589f08-523b-4081-ba1c-b62241c93fa0',
message: 'You are past the per-minute request limit for this model, please wait and try again later.'
},
rawResponse: {
headers: Headers {
'access-control-expose-headers': 'X-Debug-Trace-ID',
'cache-control': 'no-cache, no-store, no-transform, must-revalidate, private, max-age=0',
'content-encoding': 'gzip',
'content-type': 'application/json',
expires: 'Thu, 01 Jan 1970 00:00:00 GMT',
pragma: 'no-cache',
vary: 'Origin,Accept-Encoding',
'x-accel-expires': '0',
'x-debug-trace-id': 'd264049dc24c2173ff4225be669e1870',
date: 'Sat, 02 May 2026 20:52:48 GMT',
'x-envoy-upstream-service-time': '4',
server: 'envoy',
via: '1.1 google',
'alt-svc': 'h3=":443"; ma=2592000',
'transfer-encoding': 'chunked'
},
redirected: false,
status: 429,
statusText: 'Too Many Requests',
type: 'basic',
url: 'https://api.cohere.com/v2/chat'
}
}
❯ V2Client.<anonymous> .bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@8.0.0_@aws-crypto+sha256-js@5.2.0_@aws-sdk+credential-providers@3.1028.0_@smi_3c0e0b28ba619f4d228bdc6609f3a04e/node_modules/cohere-ai/api/resources/v2/client/Client.js:126:31
❯ fulfilled .bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@8.0.0_@aws-crypto+sha256-js@5.2.0_@aws-sdk+credential-providers@3.1028.0_@smi_3c0e0b28ba619f4d228bdc6609f3a04e/node_modules/cohere-ai/api/resources/v2/client/Client.js:39:58
❯ runScenarioDirOrThrow helpers/scenario-harness.ts:318:11
❯ runScenarioDir helpers/scenario-harness.ts:337:10
❯ runWithContext helpers/scenario-harness.ts:453:20
❯ Object.runScenario scenarios/cohere-instrumentation/scenario.test.ts:34:9
❯ scenarios/cohere-instrumentation/assertions.ts:116:9
❯ withScenarioHarness helpers/scenario-harness.ts:466:5
❯ scenarios/cohere-instrumentation/assertions.ts:115:7
|
|
scenarios/cohere-instrumentation/scenario.test.ts > cohere sdk 7.21.0 > auto-hook instrumentation:
e2e/helpers/scenario-harness.ts#L318
Error: Scenario /home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/scenario.cohere-v7.mjs failed with exit code 1
STDOUT:
STDERR:
TooManyRequestsError: TooManyRequestsError
Status code: 429
Body: {
"id": "af5a9a40-9f29-4ddf-8637-641414c29f8c",
"message": "You are past the per-month request limit for this model, please wait and try again later."
}
at V2Client.<anonymous> (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:211:19)
at Generator.next (<anonymous>)
at fulfilled (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:59:24)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5) {
statusCode: 429,
body: {
id: 'af5a9a40-9f29-4ddf-8637-641414c29f8c',
message: 'You are past the per-month request limit for this model, please wait and try again later.'
},
rawResponse: {
headers: Headers {
'access-control-expose-headers': 'X-Debug-Trace-ID',
'cache-control': 'no-cache, no-store, no-transform, must-revalidate, private, max-age=0',
'content-encoding': 'gzip',
'content-type': 'application/json',
expires: 'Thu, 01 Jan 1970 00:00:00 GMT',
pragma: 'no-cache',
vary: 'Origin,Accept-Encoding',
'x-accel-expires': '0',
'x-debug-trace-id': 'adc9d824a326809d7bcd445112781cc4',
date: 'Sat, 02 May 2026 20:52:43 GMT',
'x-envoy-upstream-service-time': '4',
server: 'envoy',
via: '1.1 google',
'alt-svc': 'h3=":443"; ma=2592000',
'transfer-encoding': 'chunked'
},
redirected: false,
status: 429,
statusText: 'Too Many Requests',
type: 'basic',
url: 'https://api.cohere.com/v2/chat'
}
}
❯ V2Client.<anonymous> .bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:211:19
❯ fulfilled .bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:59:24
❯ runScenarioDirOrThrow helpers/scenario-harness.ts:318:11
❯ runNodeScenarioDir helpers/scenario-harness.ts:351:10
❯ runWithContext helpers/scenario-harness.ts:453:20
❯ Object.runScenario scenarios/cohere-instrumentation/scenario.test.ts:53:9
❯ scenarios/cohere-instrumentation/assertions.ts:116:9
❯ withScenarioHarness helpers/scenario-harness.ts:466:5
❯ scenarios/cohere-instrumentation/assertions.ts:115:7
|
|
scenarios/cohere-instrumentation/scenario.test.ts > cohere sdk 7.21.0 > wrapped instrumentation:
e2e/helpers/scenario-harness.ts#L318
Error: Scenario /home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/scenario.cohere-v7.ts failed with exit code 1
STDOUT:
STDERR:
TooManyRequestsError: TooManyRequestsError
Status code: 429
Body: {
"id": "01722c14-c337-44d1-8b17-bae4a428edab",
"message": "You are past the per-month request limit for this model, please wait and try again later."
}
at V2Client.<anonymous> (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:126:31)
at Generator.next (<anonymous>)
at fulfilled (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:39:58)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5) {
statusCode: 429,
body: {
id: '01722c14-c337-44d1-8b17-bae4a428edab',
message: 'You are past the per-month request limit for this model, please wait and try again later.'
},
rawResponse: {
headers: Headers {
'access-control-expose-headers': 'X-Debug-Trace-ID',
'cache-control': 'no-cache, no-store, no-transform, must-revalidate, private, max-age=0',
'content-encoding': 'gzip',
'content-type': 'application/json',
expires: 'Thu, 01 Jan 1970 00:00:00 GMT',
pragma: 'no-cache',
vary: 'Origin,Accept-Encoding',
'x-accel-expires': '0',
'x-debug-trace-id': '5ea4d1b8718c2a7793f9406bc7406df7',
date: 'Sat, 02 May 2026 20:52:38 GMT',
'x-envoy-upstream-service-time': '6',
server: 'envoy',
via: '1.1 google',
'alt-svc': 'h3=":443"; ma=2592000',
'transfer-encoding': 'chunked'
},
redirected: false,
status: 429,
statusText: 'Too Many Requests',
type: 'basic',
url: 'https://api.cohere.com/v2/chat'
}
}
❯ V2Client.<anonymous> .bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:126:31
❯ fulfilled .bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:39:58
❯ runScenarioDirOrThrow helpers/scenario-harness.ts:318:11
❯ runScenarioDir helpers/scenario-harness.ts:337:10
❯ runWithContext helpers/scenario-harness.ts:453:20
❯ Object.runScenario scenarios/cohere-instrumentation/scenario.test.ts:34:9
❯ scenarios/cohere-instrumentation/assertions.ts:116:9
❯ withScenarioHarness helpers/scenario-harness.ts:466:5
❯ scenarios/cohere-instrumentation/assertions.ts:115:7
|
|
scenarios/cohere-instrumentation/scenario.test.ts > cohere sdk 7.21.0 > auto-hook instrumentation:
e2e/helpers/scenario-harness.ts#L318
Error: Scenario /home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/scenario.cohere-v7.mjs failed with exit code 1
STDOUT:
STDERR:
TooManyRequestsError: TooManyRequestsError
Status code: 429
Body: {
"id": "78a7c0a5-f949-4c4a-b515-3dc92834a6c4",
"message": "You are past the per-month request limit for this model, please wait and try again later."
}
at V2Client.<anonymous> (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:211:19)
at Generator.next (<anonymous>)
at fulfilled (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:59:24)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5) {
statusCode: 429,
body: {
id: '78a7c0a5-f949-4c4a-b515-3dc92834a6c4',
message: 'You are past the per-month request limit for this model, please wait and try again later.'
},
rawResponse: {
headers: Headers {
'access-control-expose-headers': 'X-Debug-Trace-ID',
'cache-control': 'no-cache, no-store, no-transform, must-revalidate, private, max-age=0',
'content-encoding': 'gzip',
'content-type': 'application/json',
expires: 'Thu, 01 Jan 1970 00:00:00 GMT',
pragma: 'no-cache',
vary: 'Origin,Accept-Encoding',
'x-accel-expires': '0',
'x-debug-trace-id': 'b25eb8102b706fc852ffa5b517f753a8',
date: 'Sat, 02 May 2026 20:52:33 GMT',
'x-envoy-upstream-service-time': '6',
server: 'envoy',
via: '1.1 google',
'alt-svc': 'h3=":443"; ma=2592000',
'transfer-encoding': 'chunked'
},
redirected: false,
status: 429,
statusText: 'Too Many Requests',
type: 'basic',
url: 'https://api.cohere.com/v2/chat'
}
}
❯ V2Client.<anonymous> .bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:211:19
❯ fulfilled .bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:59:24
❯ runScenarioDirOrThrow helpers/scenario-harness.ts:318:11
❯ runNodeScenarioDir helpers/scenario-harness.ts:351:10
❯ runWithContext helpers/scenario-harness.ts:453:20
❯ Object.runScenario scenarios/cohere-instrumentation/scenario.test.ts:53:9
❯ scenarios/cohere-instrumentation/assertions.ts:116:9
❯ withScenarioHarness helpers/scenario-harness.ts:466:5
❯ scenarios/cohere-instrumentation/assertions.ts:115:7
|
|
scenarios/cohere-instrumentation/scenario.test.ts > cohere sdk 7.21.0 > wrapped instrumentation:
e2e/helpers/scenario-harness.ts#L318
Error: Scenario /home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/scenario.cohere-v7.ts failed with exit code 1
STDOUT:
STDERR:
TooManyRequestsError: TooManyRequestsError
Status code: 429
Body: {
"id": "a111ebd3-81c6-49e6-bfac-04335afe5dbf",
"message": "You are past the per-month request limit for this model, please wait and try again later."
}
at V2Client.<anonymous> (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:126:31)
at Generator.next (<anonymous>)
at fulfilled (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:39:58)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5) {
statusCode: 429,
body: {
id: 'a111ebd3-81c6-49e6-bfac-04335afe5dbf',
message: 'You are past the per-month request limit for this model, please wait and try again later.'
},
rawResponse: {
headers: Headers {
'access-control-expose-headers': 'X-Debug-Trace-ID',
'cache-control': 'no-cache, no-store, no-transform, must-revalidate, private, max-age=0',
'content-encoding': 'gzip',
'content-type': 'application/json',
expires: 'Thu, 01 Jan 1970 00:00:00 GMT',
pragma: 'no-cache',
vary: 'Origin,Accept-Encoding',
'x-accel-expires': '0',
'x-debug-trace-id': 'cb52e0b579dd32c90b21bc7ac3427747',
date: 'Sat, 02 May 2026 20:52:28 GMT',
'x-envoy-upstream-service-time': '4',
server: 'envoy',
via: '1.1 google',
'alt-svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000',
'transfer-encoding': 'chunked'
},
redirected: false,
status: 429,
statusText: 'Too Many Requests',
type: 'basic',
url: 'https://api.cohere.com/v2/chat'
}
}
❯ V2Client.<anonymous> .bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:126:31
❯ fulfilled .bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:39:58
❯ runScenarioDirOrThrow helpers/scenario-harness.ts:318:11
❯ runScenarioDir helpers/scenario-harness.ts:337:10
❯ runWithContext helpers/scenario-harness.ts:453:20
❯ Object.runScenario scenarios/cohere-instrumentation/scenario.test.ts:34:9
❯ scenarios/cohere-instrumentation/assertions.ts:116:9
❯ withScenarioHarness helpers/scenario-harness.ts:466:5
❯ scenarios/cohere-instrumentation/assertions.ts:115:7
|
|
scenarios/cohere-instrumentation/scenario.test.ts > cohere sdk 7.20.0 > auto-hook instrumentation:
e2e/helpers/scenario-harness.ts#L318
Error: Scenario /home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/scenario.cohere-v7.mjs failed with exit code 1
STDOUT:
STDERR:
TooManyRequestsError: TooManyRequestsError
Status code: 429
Body: {
"id": "f69274b7-d58e-454e-9943-4898b6711261",
"message": "You are past the per-month request limit for this model, please wait and try again later."
}
at V2Client.<anonymous> (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:211:19)
at Generator.next (<anonymous>)
at fulfilled (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:59:24)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5) {
statusCode: 429,
body: {
id: 'f69274b7-d58e-454e-9943-4898b6711261',
message: 'You are past the per-month request limit for this model, please wait and try again later.'
},
rawResponse: {
headers: Headers {
'access-control-expose-headers': 'X-Debug-Trace-ID',
'cache-control': 'no-cache, no-store, no-transform, must-revalidate, private, max-age=0',
'content-encoding': 'gzip',
'content-type': 'application/json',
expires: 'Thu, 01 Jan 1970 00:00:00 GMT',
pragma: 'no-cache',
vary: 'Origin,Accept-Encoding',
'x-accel-expires': '0',
'x-debug-trace-id': '35cb3ec34522baa5dca19320a81492d0',
date: 'Sat, 02 May 2026 20:52:23 GMT',
'x-envoy-upstream-service-time': '5',
server: 'envoy',
via: '1.1 google',
'alt-svc': 'h3=":443"; ma=2592000',
'transfer-encoding': 'chunked'
},
redirected: false,
status: 429,
statusText: 'Too Many Requests',
type: 'basic',
url: 'https://api.cohere.com/v2/chat'
}
}
❯ V2Client.<anonymous> .bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:211:19
❯ fulfilled .bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:59:24
❯ runScenarioDirOrThrow helpers/scenario-harness.ts:318:11
❯ runNodeScenarioDir helpers/scenario-harness.ts:351:10
❯ runWithContext helpers/scenario-harness.ts:453:20
❯ Object.runScenario scenarios/cohere-instrumentation/scenario.test.ts:53:9
❯ scenarios/cohere-instrumentation/assertions.ts:116:9
❯ withScenarioHarness helpers/scenario-harness.ts:466:5
❯ scenarios/cohere-instrumentation/assertions.ts:115:7
|
|
scenarios/cohere-instrumentation/scenario.test.ts > cohere sdk 7.20.0 > wrapped instrumentation:
e2e/helpers/scenario-harness.ts#L318
Error: Scenario /home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/scenario.cohere-v7.ts failed with exit code 1
STDOUT:
STDERR:
TooManyRequestsError: TooManyRequestsError
Status code: 429
Body: {
"id": "b1be4dde-200d-436c-b258-947a4a897a35",
"message": "You are past the per-month request limit for this model, please wait and try again later."
}
at V2Client.<anonymous> (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:126:31)
at Generator.next (<anonymous>)
at fulfilled (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e/.bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:39:58)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5) {
statusCode: 429,
body: {
id: 'b1be4dde-200d-436c-b258-947a4a897a35',
message: 'You are past the per-month request limit for this model, please wait and try again later.'
},
rawResponse: {
headers: Headers {
'access-control-expose-headers': 'X-Debug-Trace-ID',
'cache-control': 'no-cache, no-store, no-transform, must-revalidate, private, max-age=0',
'content-encoding': 'gzip',
'content-type': 'application/json',
expires: 'Thu, 01 Jan 1970 00:00:00 GMT',
pragma: 'no-cache',
vary: 'Origin,Accept-Encoding',
'x-accel-expires': '0',
'x-debug-trace-id': '2e7b05bd57cfb3629ee605ad654ed43e',
date: 'Sat, 02 May 2026 20:52:18 GMT',
'x-envoy-upstream-service-time': '11',
server: 'envoy',
via: '1.1 google',
'alt-svc': 'h3=":443"; ma=2592000',
'transfer-encoding': 'chunked'
},
redirected: false,
status: 429,
statusText: 'Too Many Requests',
type: 'basic',
url: 'https://api.cohere.com/v2/chat'
}
}
❯ V2Client.<anonymous> .bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:126:31
❯ fulfilled .bt-tmp/run-I7PxVI/scenarios/cohere-instrumentation/node_modules/.pnpm/cohere-ai@7.21.0/node_modules/cohere-ai/api/resources/v2/client/Client.js:39:58
❯ runScenarioDirOrThrow helpers/scenario-harness.ts:318:11
❯ runScenarioDir helpers/scenario-harness.ts:337:10
❯ runWithContext helpers/scenario-harness.ts:453:20
❯ Object.runScenario scenarios/cohere-instrumentation/scenario.test.ts:34:9
❯ scenarios/cohere-instrumentation/assertions.ts:116:9
❯ withScenarioHarness helpers/scenario-harness.ts:466:5
❯ scenarios/cohere-instrumentation/assertions.ts:115:7
|
|
e2e
@braintrust/js-e2e-tests#test:e2e: command (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e) /home/runner/setup-pnpm/node_modules/.bin/pnpm run test:e2e exited (1)
|
|
e2e-canary
Process completed with exit code 1.
|
|
e2e-canary
@braintrust/js-e2e-tests#test:e2e:canary: command (/home/runner/work/braintrust-sdk-javascript/braintrust-sdk-javascript/e2e) /home/runner/setup-pnpm/node_modules/.bin/pnpm run test:e2e:canary exited (1)
|
|
js-provider-tests (ubuntu-latest, 22)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5, actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
js-provider-tests (ubuntu-latest, 20)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5, actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
js-provider-tests (windows-latest, 22)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5, actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
js-provider-tests (windows-latest, 20)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5, actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
e2e
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5, actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
e2e-canary
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5, actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|