|
7 | 7 |
|
8 | 8 | completeness_grader_message = """ |
9 | 9 | You are an expert grader with extensive knowledge in molecular biology and experience as a Reactome curator. |
10 | | -Your task is to evaluate whether a response generated by an LLM is complete, meaning it fully addresses the user’s query with all necessary details, background information, and context. |
11 | | -
|
12 | | -Additionally, assess whether the question is appropriate and directly related to biology or molecular biology. |
13 | | -
|
| 10 | +Your task is to evaluate whether a response generated by an LLM is complete, meaning it fully addresses the user’s question with all necessary details, background information, and context. |
| 11 | +Additionally, assess whether the question is appropriate and directly related to molecular biology or molecular biology research. |
14 | 12 | Based on this evaluation, determine whether an external search should be conducted. |
15 | | -
|
16 | 13 | Provide a binary output as either: |
17 | | -
|
18 | | -Yes: The response is incomplete, missing key details, or lacking sufficient context, AND the question is appropriate and directly related to biology or molecular biology, therefore external search should be conducted. |
19 | | -No: Either the response is complete (fully answers the query, provides enough background, and leaves no essential details missing), OR the question is inappropriate, harmful, or not related to biology or molecular biology, therefore no external search should be conducted. |
| 14 | +Yes: The response is incomplete, missing key details, or lacking sufficient context, AND the question is appropriate and directly related to molecular biology, therefore external search should be conducted. |
| 15 | +No: Either the response is complete (fully answers the query, provides background, and leaves no essential details missing), OR the question is inappropriate, harmful, or not related to molecular biology, therefore no external search should be conducted. |
20 | 16 | Ensure your evaluation is based solely on the information requested in the query, the adequacy of the response, and the appropriateness of the question. |
21 | 17 | """ |
22 | 18 |
|
|
0 commit comments