Skip to content

Commit 54bb583

Browse files
authored
chore(benchmarks): removed unused validate scorer endpoint (#716)
1 parent f4ba135 commit 54bb583

2 files changed

Lines changed: 2 additions & 8 deletions

File tree

README.md

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -61,7 +61,7 @@ The SDK provides object-oriented interfaces for all major Runloop resources:
6161
- **[`runloop.storageObject`](https://runloopai.github.io/api-client-ts/stable/classes/StorageObjectOps.html)** - Storage object management (upload, download, list objects)
6262
- **[`runloop.agent`](https://runloopai.github.io/api-client-ts/stable/classes/AgentOps.html)** - Agent management (create, list agents from npm/pip/git)
6363
- **[`runloop.scenario`](https://runloopai.github.io/api-client-ts/stable/classes/ScenarioOps.html)** - Scenario management (list scenarios, start runs)
64-
- **[`runloop.scorer`](https://runloopai.github.io/api-client-ts/stable/classes/ScorerOps.html)** - Scorer management (create, list, validate, update)
64+
- **[`runloop.scorer`](https://runloopai.github.io/api-client-ts/stable/classes/ScorerOps.html)** - Scorer management (create, list, update)
6565
- **[`runloop.api`](https://runloopai.github.io/api-client-ts/stable/classes/Runloop.html)** - Direct access to the REST API client
6666

6767
## TypeScript Support
@@ -88,7 +88,7 @@ const devbox = await blueprint.createDevbox({ name: 'my-devbox' });
8888

8989
### Scorers
9090

91-
Scorers are custom scoring functions used to evaluate scenario outputs. Create scorers via `runloop.scorer.create()`, then update or validate them with the returned `Scorer` instance:
91+
Scorers are custom scoring functions used to evaluate scenario outputs. Create scorers via `runloop.scorer.create()`, then update them with the returned `Scorer` instance:
9292

9393
```typescript
9494
import { RunloopSDK } from '@runloop/api-client';
@@ -101,8 +101,6 @@ const scorer = await runloop.scorer.create({
101101
});
102102

103103
await scorer.update({ bash_script: 'echo "0.5"' });
104-
const result = await scorer.validate({ scoring_context: { output: 'hello' } });
105-
console.log(result.scoring_result.score);
106104
```
107105

108106
### Scenarios

src/sdk.ts

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1332,10 +1332,6 @@ export class AgentOps {
13321332
*
13331333
* // Update the scorer
13341334
* await scorer.update({ bash_script: 'echo "0.5"' });
1335-
*
1336-
* // Validate the scorer with a scoring context
1337-
* const result = await scorer.validate({ scoring_context: { output: 'hello' } });
1338-
* console.log(result.scoring_result.score);
13391335
* ```
13401336
*
13411337
* @example

0 commit comments

Comments
 (0)