Skip to content

Commit eb31653

Browse files
authored
fix answer_choices (1,2,3,4 vs a,b,c,d) in ai2 arc (#699)
1 parent f5fc035 commit eb31653

File tree

2 files changed

+4
-4
lines changed

2 files changed

+4
-4
lines changed

promptsource/templates/ai2_arc/ARC-Challenge/templates.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,7 @@ templates:
3232
name: pick_false_options
3333
reference: ''
3434
540ebc31-2ea6-4feb-a6fd-67b6e71cf20a: !Template
35-
answer_choices: A ||| B ||| C ||| D
35+
answer_choices: '{{choices.label | join("|||")}}'
3636
id: 540ebc31-2ea6-4feb-a6fd-67b6e71cf20a
3737
jinja: "Here's a problem to solve: {{question}}\n\nAmong the 4 following options,\
3838
\ which is the correct answer?\n{% for letter, t in zip(answer_choices, choices.text)\
@@ -104,7 +104,7 @@ templates:
104104
name: multiple_choice
105105
reference: ''
106106
e371fc1a-8edb-477b-b345-9d73e97ffade: !Template
107-
answer_choices: A ||| B ||| C ||| D
107+
answer_choices: '{{choices.label | join("|||")}}'
108108
id: e371fc1a-8edb-477b-b345-9d73e97ffade
109109
jinja: 'Pick the most correct option to answer the following question.
110110

promptsource/templates/ai2_arc/ARC-Easy/templates.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@ dataset: ai2_arc
22
subset: ARC-Easy
33
templates:
44
033498ca-3d9a-47e3-b631-d881ab53b5ad: !Template
5-
answer_choices: A ||| B ||| C ||| D
5+
answer_choices: '{{choices.label | join("|||")}}'
66
id: 033498ca-3d9a-47e3-b631-d881ab53b5ad
77
jinja: 'Pick the most correct option to answer the following question.
88
@@ -116,7 +116,7 @@ templates:
116116
name: pick_false_options
117117
reference: ''
118118
d90da519-0e2c-4f9b-a546-7cba82824eb2: !Template
119-
answer_choices: A ||| B ||| C ||| D
119+
answer_choices: '{{choices.label | join("|||")}}'
120120
id: d90da519-0e2c-4f9b-a546-7cba82824eb2
121121
jinja: "Here's a problem to solve: {{question}}\n\nAmong the 4 following options,\
122122
\ which is the correct answer?\n{% for letter, t in zip(answer_choices, choices.text)\

0 commit comments

Comments
 (0)