We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
2 parents 619fdfe + 2603874 commit 67c57eaCopy full SHA for 67c57ea
1 file changed
config/text-summarizer-eval.yaml
@@ -0,0 +1,23 @@
1
+name: Text Summarizer
2
+description: Summarizes input text concisely
3
+model: openai/gpt-4o-mini
4
+modelParameters:
5
+ temperature: 0.5
6
+messages:
7
+ - role: system
8
+ content: You are a text summarizer. Your only job is to summarize text given to you.
9
+ - role: user
10
+ content: |
11
+ Summarize the given text, beginning with "Summary -":
12
+ <text>
13
+ {{input}}
14
+ </text>
15
+testData:
16
+ - input: |
17
+ The quick brown fox jumped over the lazy dog.
18
+ The dog was too tired to react.
19
+ expected: Summary - A fox jumped over a lazy, unresponsive dog.
20
+evaluators:
21
+ - name: Output should start with 'Summary -'
22
+ string:
23
+ startsWith: 'Summary -'
0 commit comments