Skip to content

Commit c62f6f1

Browse files
committed
Enhance code generation dataset and improve example evaluation with timeout handling
- Added a new function to evaluate mathematical expressions respecting operator precedence and parentheses to the code generation dataset. - Introduced a function to merge overlapping intervals in the code generation dataset. - Modified the _evaluate_examples function to include a timeout feature for LLM calls, ensuring that each example is evaluated within a specified time limit. - Improved error handling and output formatting during example evaluations to provide clearer feedback on timeouts and errors.
1 parent b658a6c commit c62f6f1

5 files changed

Lines changed: 392 additions & 285 deletions

File tree

.gitignore

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -54,3 +54,4 @@ csv/*.csv
5454
screenshots/
5555
*.png
5656
.mcp.json
57+
notebooks/.ipynb_checkpoints/*

.vscode/launch.json

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -22,6 +22,13 @@
2222
"runtimeArgs": ["run", "dev"],
2323
"console": "integratedTerminal"
2424
},
25+
{
26+
"name": "Make LLM Great Again",
27+
"type": "node-terminal",
28+
"request": "launch",
29+
"command": "./start.sh",
30+
"cwd": "${workspaceFolder}/notebooks"
31+
},
2532
{
2633
"name": "Frontend: Chromium",
2734
"type": "chrome",

0 commit comments

Comments
 (0)