Commit c62f6f1
committed
Enhance code generation dataset and improve example evaluation with timeout handling
- Added a new function to evaluate mathematical expressions respecting operator precedence and parentheses to the code generation dataset.
- Introduced a function to merge overlapping intervals in the code generation dataset.
- Modified the _evaluate_examples function to include a timeout feature for LLM calls, ensuring that each example is evaluated within a specified time limit.
- Improved error handling and output formatting during example evaluations to provide clearer feedback on timeouts and errors.1 parent b658a6c commit c62f6f1
5 files changed
Lines changed: 392 additions & 285 deletions
File tree
- .vscode
- notebooks
- datasets
- dspy_tasks
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
54 | 54 | | |
55 | 55 | | |
56 | 56 | | |
| 57 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
22 | 22 | | |
23 | 23 | | |
24 | 24 | | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
25 | 32 | | |
26 | 33 | | |
27 | 34 | | |
| |||
0 commit comments