Skip to content

Commit 3b34514

Browse files
Add sample for emitting human evaluation events (#46962)
1 parent 777e6cc commit 3b34514

6 files changed

Lines changed: 758 additions & 3 deletions

File tree

sdk/ai/azure-ai-projects/cspell.json

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -38,14 +38,17 @@
3838
"Udbk",
3939
"UPIA",
4040
"Vnext",
41-
"xhigh"
41+
"xhigh",
42+
"likert"
4243
],
4344
"ignorePaths": [
4445
"*.csv",
4546
"*.json",
4647
"*.jsonl"
4748
],
4849
"words": [
49-
"Pxqzykebv"
50+
"Pxqzykebv",
51+
"qtumf",
52+
"sess"
5053
]
5154
}

sdk/ai/azure-ai-projects/samples/evaluations/README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -69,6 +69,7 @@ These samples require additional setup or Azure services:
6969
| [sample_evaluations_score_model_grader_with_audio.py](https://github.com/Azure/azure-sdk-for-python/blob/main/sdk/ai/azure-ai-projects/samples/evaluations/sample_evaluations_score_model_grader_with_audio.py) | Evaluate with audio data | Audio file, audio-capable model deployment |
7070
| [sample_evaluations_score_model_grader_with_audio_model_target.py](https://github.com/Azure/azure-sdk-for-python/blob/main/sdk/ai/azure-ai-projects/samples/evaluations/sample_evaluations_score_model_grader_with_audio_model_target.py) | Evaluate audio data using a model as the target | Audio file, audio-capable model deployment |
7171
| [sample_evaluations_builtin_with_inline_data_oai.py](https://github.com/Azure/azure-sdk-for-python/blob/main/sdk/ai/azure-ai-projects/samples/evaluations/sample_evaluations_builtin_with_inline_data_oai.py) | Use OpenAI client directly | OpenAI SDK |
72+
| [sample_human_evaluations.py](https://github.com/Azure/azure-sdk-for-python/blob/main/sdk/ai/azure-ai-projects/samples/evaluations/sample_human_evaluations.py) | Emit human evaluation events (binary / Likert-5) as OpenTelemetry custom events to Application Insights | Connected Application Insights on Foundry Project, `azure-monitor-opentelemetry` |
7273

7374
### Evaluator Types
7475

0 commit comments

Comments
 (0)