create_judge

Create Judge Example

This example demonstrates how to use LaunchDarkly's create_judge method to evaluate specific input/output pairs directly, without an associated chat session.

Prerequisites

• Python 3.10 or higher
• Poetry installed
• A LaunchDarkly account and SDK key
• API keys for the provider you want to use (OpenAI, Bedrock, or Gemini)

Setup

1. Create the following config in your LaunchDarkly project. You can use a different key by setting the environment variable in your .env.

   • Create a Judge Config for evaluation. Default key: sample-judge.

2. Copy .env.example to .env and fill in your keys:

   cp .env.example .env

3. Install the required dependencies:

   poetry install

Run

poetry run judge