Skip to content

Commit 9646208

Browse files
committed
docs(apollo11/prompts):add 15 standardized test prompts for dataset evaluation
1 parent 07a57a1 commit 9646208

1 file changed

Lines changed: 86 additions & 0 deletions

File tree

Lines changed: 86 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,86 @@
1+
<!-- markdownlint-disable MD001 -->
2+
<!-- skipping H2 to go directly to H3 for visual reasons -->
3+
4+
# 15 Standardized Test Prompts
5+
6+
### Summarization Tasks (5 prompts)
7+
8+
#### Prompt 1 (Easy)
9+
10+
Summarize the main events during the Apollo 11 lunar landing in 3 sentences.
11+
12+
#### Prompt 2 (Easy)
13+
14+
What were the main challenges Armstrong faced while landing the Eagle?
15+
16+
#### Prompt 3 (Medium)
17+
18+
Describe the activities the astronauts performed on the lunar surface.
19+
20+
#### Prompt 4 (Medium)
21+
22+
Explain what scientific equipment the astronauts deployed on the Moon.
23+
24+
#### Prompt 5 (Hard)
25+
26+
Compare the planned timeline for the lunar surface operations with what actually
27+
happened.
28+
29+
### Reasoning Tasks (5 prompts)
30+
31+
#### Prompt 6 (Easy)
32+
33+
Why did the computer alarms (1201 and 1202) occur during the descent?
34+
35+
#### Prompt 7 (Medium)
36+
37+
What would have happened if Armstrong had not taken manual control during the landing?
38+
39+
#### Prompt 8 (Medium)
40+
41+
Why did Armstrong's famous quote become controversial?
42+
43+
#### Prompt 9 (Hard)
44+
45+
Analyze how the fuel situation during landing reflects the risk management challenges
46+
of the mission.
47+
48+
#### Prompt 10 (Hard)
49+
50+
Based on the text, what does Margaret Hamilton's statement reveal about the Apollo
51+
Guidance Computer's design philosophy?
52+
53+
### RAG Tasks (5 prompts)
54+
55+
#### Prompt 11 (Easy)
56+
57+
At what time (UTC) did Eagle land on the Moon?
58+
59+
#### Prompt 12 (Easy)
60+
61+
How much lunar material did the astronauts collect?
62+
63+
#### Prompt 13 (Medium)
64+
65+
What was Armstrong's famous first words when stepping on the Moon?
66+
67+
#### Prompt 14 (Medium)
68+
69+
What scientific instruments were included in the EASEP package?
70+
71+
#### Prompt 15 (Hard)
72+
73+
How much usable fuel remained when Eagle landed, and how many seconds of powered
74+
flight did this represent?
75+
76+
---
77+
78+
### Expected Answers for RAG Tasks
79+
80+
**Prompt 11:** 20:17:40 UTC on July 20, 1969
81+
**Prompt 12:** 21.55 kilograms (47.5 lb)
82+
**Prompt 13:** "That's one small step for [a] man, one giant leap for mankind"
83+
**Prompt 14:** Passive Seismic Experiment Package and retroreflector array
84+
(for lunar laser ranging experiment)
85+
**Prompt 15:** 216 pounds (98 kg); estimated 25 seconds according to initial data,
86+
but post-mission analysis showed closer to 50 seconds

0 commit comments

Comments
 (0)