You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: src/pages/gsoc_ideas.mdx
+40Lines changed: 40 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -16,6 +16,7 @@ Below is a list of project ideas. Feel free to contact the listed mentors on Sla
16
16
2.[Benchmarking and Validation Framework](#validation)
17
17
3.[Increase PEcAn modularity](#module)
18
18
4.[Standardizing Model Couplers Across Models](#couplertools)
19
+
5.[LLM-Assisted Extraction of Agronomic Experiments into BETYdb](#llm-betydb)
19
20
20
21
---
21
22
@@ -174,6 +175,45 @@ Medium (175hr) or Large (350 hr) depending on number of deliverables
174
175
175
176
**Difficulty:**
176
177
Medium
178
+
179
+
---
180
+
### 5. LLM-Assisted Extraction of Agronomic Experiments into BETYdb{#llm-betydb}
181
+
182
+
Manual extraction of agronomic and ecological experiments from scientific literature into BETYdb is slow, error-prone, and labor-intensive. Researchers must interpret complex experimental designs, reconstruct management timelines, identify treatments and controls, handle factorial structures, and link outcomes with correct covariates and uncertainty estimates—tasks that require scientific judgment beyond simple text extraction. Current manual workflows can take hours per paper and introduce inconsistencies that compromise downstream data quality and meta-analyses.
183
+
184
+
This project proposes a human-supervised, LLM-based system to accelerate BETYdb data entry while preserving scientific rigor and traceability. The system will ingest PDFs of scientific papers and produce upload-ready BETYdb entries (sites, treatments, management time series, traits, and yields) with every field labeled as extracted, inferred, or unresolved and linked to provenance evidence in the source document. The system leverages existing labeled training data (scientific papers with ground-truth BETYdb entries).
185
+
186
+
The architecture follows a two-layer design: (1) a schema-validated intermediate representation (IR) preserving evidence links, confidence scores, and flagged conflicts, and (2) a BETYdb materialization layer that enforces BETYdb semantics, validation rules, and generates upload-ready CSVs or API payloads with full audit trails. Implementation is flexible—ranging from agentic LLM workflows to fine-tuned specialist models to an adaptive hybrid—and should be informed by empirical evaluation during the project.
187
+
188
+
**Expected outcomes:**
189
+
190
+
A successful project would complete the following tasks:
191
+
192
+
* IR schema definition with validation rules and documented field semantics covering sites, treatments, managements, and traits/yields
193
+
* Modular extraction pipeline for document parsing, information extraction, and IR generation with clear separation between extraction and validation logic
194
+
* Independent validators for BETYdb semantics, unit consistency, temporal logic, and required fields
195
+
* BETYdb export module producing upload-ready management CSVs and bulk trait upload formats with full provenance preservation
196
+
* Scientist-in-the-loop review interface for approving, correcting, or rejecting extracted entries with inline evidence and confidence scores
197
+
* Evaluation harness with automated metrics for extraction accuracy, inference quality, coverage, and time savings on held-out test papers
198
+
* Documentation covering IR schema specification, developer guidance for adding new extraction components, and user guidance for the review interface
199
+
200
+
**Prerequisites:**
201
+
202
+
- Required: R Shiny, Python (familiarity with scientific literature and experimental design concepts)
203
+
- Helpful: experience with LLM APIs (Anthropic, OpenAI) or fine-tuning frameworks, knowledge of BETYdb schema and workflows, familiarity with agronomic or ecological experimental designs
204
+
205
+
**Contact person:**
206
+
207
+
Nihar Sanda (@koolgax99), David LeBauer (@dlebauer)
0 commit comments