You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: source/instructors/authoring/assessments/llm-based-rubric.rst
+12-4Lines changed: 12 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,7 @@
6
6
7
7
LLM-Based Rubric Grader
8
8
=======================
9
-
You can find the **LLM Based Rubric** assessment in the **Manually Graded** section of the Assessments tab. More information about adding assessments can be found in :ref:`our assessment documentation <add-assessment>`.
9
+
You can find the **LLM Based Rubric** assessment in the **Manually Graded** section of the Assessments tab. More information about adding assessments can be found in our :ref:`assessment documentation <add-assessment>`.
10
10
11
11
There are three steps to this process.
12
12
@@ -38,7 +38,7 @@ Add an **LLM Based Rubric** assessment to your guide page and follow the steps b
38
38
:height:600
39
39
:alt:Generate a rubric
40
40
41
-
- Then, click the **Generate Rubrics** (2) button to initiate the process.
41
+
- Click the **Generate Rubrics** (2) button to initiate the process.
42
42
43
43
The **Rubric Creation Agent** uses the following items to generate the rubric items:
44
44
@@ -49,9 +49,9 @@ Add an **LLM Based Rubric** assessment to your guide page and follow the steps b
49
49
- The Course, Module, and Assignment name
50
50
- Requirements specified in the Rubric creation tab
51
51
52
-
.. Note:: You are not required to add rubric requirements; the process will also use general code grading norms to supply rubric items.
52
+
.. Note:: If you do not add rubric requirements; the process will use general code grading norms to supply rubric items.
53
53
54
-
You can add your requirements in the **Rubrics Requirements** dialog:
54
+
(optional) Add your requirements in the **Rubrics Requirements** dialog:
55
55
56
56
.. image:: /img/guides/llmrubricreqs.png
57
57
:height:600
@@ -92,3 +92,11 @@ The final step involves the instructor opening the student assignment and select
92
92
:alt:The teacher approves each comment generated by the LLM grader
93
93
94
94
95
+
Rubric Requirements Example
96
+
---------------------------
97
+
98
+
.. code-block:: text
99
+
100
+
Use the following criteria, assigning equal weight to each one.
101
+
- Program correctness
102
+
- Proper and efficient usage of a dictionary data structure
0 commit comments