Commit de0d81f
Release: main → prod (#23)
* Added GitHub Actions release workflow and updated build workflow to trigger on version tags (#18)
* Feature/release workflow (#20)
* Added GitHub Actions release workflow and updated build workflow to trigger on version tags
* Triggered evaluation-function-base release from release workflow
* Updated GitHub Actions build workflow to enable `latest` image tagging only for tag refs (#22)
* Add µEd OpenAPI validation middleware (#17)
* Added OpenAPI request/response validation middleware and integrated OpenAPI specification
* Add embedded µEd OpenAPI specification
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* Move µEd OpenAPI spec into runtime/schema
Relocates the spec from api/ into runtime/schema/ alongside the existing
JSON schema files, and renames it to mued_v0.1.0.yml to make the version
explicit. Removes the api/ package; embed is now owned by runtime/schema.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* Ignore .idea/ directory
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* Make OpenAPI response validation strict for µEd routes
Previously, responses that failed spec validation were only logged as
warnings and forwarded anyway. Now a failed µEd response validation
returns 500 to the caller. The legacy / route is unaffected — it has
no matching path in the spec so the middleware passes it through
unchanged.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* Update Go version to 1.25 in Dockerfile for builder stage
* Support OpenAPI 3.1.0 spec in router validation
Pass IsOpenAPI31OrLater and AllowExtraSiblingFields options to the
legacy router so description/summary siblings on $ref objects (valid
in 3.1.0) don't fail validation. Also propagate errors from
OpenAPIMiddleware and NewHttpServer instead of ignoring them.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* Refactor error responses and improve OpenAPI middleware robustness
Use `writeJSONError` helper for consistent JSON error responses in µEd handler. Enhance OpenAPI response validation to prevent buffer drainage during snapshot handling.
* Add health status response to µEd handler based on test results
* Update µEd test assertion to verify "status" field instead of "tests_passed" field
---------
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
* Feature/sandboxed workers (#21)
* Added Linux-only nsjail-based sandboxing for worker processes, including CLI support, configuration, and testing.
* Added validation for `Content-Length` in `headerPrefixPipe` and tests for oversized and negative values
* Enhanced `build.yml` to compile and install nsjail from source instead of using system package.
* Switched nsjail mode from "once" to "exec" for direct command execution with inherited stdio.
* Replaced `--time_limit` with `--rlimit_cpu` in nsjail arguments to ensure compatibility in containers without cgroupv2.
* Updated sandbox test to replace `--time_limit` with `--rlimit_cpu` and adjusted workflow to run integration tests with elevated permissions.
* Feature/mu ed versioning (#14)
* Added `MuEdHandler` to handle `/evaluate` and `/evaluate/health` endpoints with authentication and runtime integration, along with associated tests
* Added `workflow_dispatch` trigger to GitHub Actions build workflow
* Removed `NewCommandRoute` and corrected route definitions for `/evaluate` and `/evaluate/health`
* Added `NormalizePath` middleware to canonicalize `/evaluate` and `/evaluate/health` paths across server and lambda integrations
* Added API versioning support for `/evaluate` and `/evaluate/health` endpoints with header validation, default version handling, and capability reporting
* Added OpenAPI request/response validation middleware and integrated OpenAPI specification
* Add embedded µEd OpenAPI specification
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* Move µEd OpenAPI spec into runtime/schema
Relocates the spec from api/ into runtime/schema/ alongside the existing
JSON schema files, and renames it to mued_v0.1.0.yml to make the version
explicit. Removes the api/ package; embed is now owned by runtime/schema.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* Ignore .idea/ directory
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* Make OpenAPI response validation strict for µEd routes
Previously, responses that failed spec validation were only logged as
warnings and forwarded anyway. Now a failed µEd response validation
returns 500 to the caller. The legacy / route is unaffected — it has
no matching path in the spec so the middleware passes it through
unchanged.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* Simplify µEd response encoding by removing unnecessary "status" field logic
---------
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
* Feature/mu ed error handling (#15)
* Added `MuEdHandler` to handle `/evaluate` and `/evaluate/health` endpoints with authentication and runtime integration, along with associated tests
* Added `workflow_dispatch` trigger to GitHub Actions build workflow
* Removed `NewCommandRoute` and corrected route definitions for `/evaluate` and `/evaluate/health`
* Added `NormalizePath` middleware to canonicalize `/evaluate` and `/evaluate/health` paths across server and lambda integrations
* Added API versioning support for `/evaluate` and `/evaluate/health` endpoints with header validation, default version handling, and capability reporting
* Refactored `/evaluate` and `/evaluate/health` error handling to standardize JSON responses with `writeMuEdError` and included `X-Api-Version` header validation and degraded health status support.
* Added OpenAPI request/response validation middleware and integrated OpenAPI specification
* Add embedded µEd OpenAPI specification
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* Move µEd OpenAPI spec into runtime/schema
Relocates the spec from api/ into runtime/schema/ alongside the existing
JSON schema files, and renames it to mued_v0.1.0.yml to make the version
explicit. Removes the api/ package; embed is now owned by runtime/schema.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* Ignore .idea/ directory
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* Make OpenAPI response validation strict for µEd routes
Previously, responses that failed spec validation were only logged as
warnings and forwarded anyway. Now a failed µEd response validation
returns 500 to the caller. The legacy / route is unaffected — it has
no matching path in the spec so the middleware passes it through
unchanged.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* Update µEd handler to use dynamic status codes for responses
---------
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
* Fix referenceSolution content extraction to match µEd spec
The spec defines task.referenceSolution as a plain object with
additionalProperties, not a typed Submission wrapper. Change
MuEdTask.ReferenceSolution from *MuEdSubmission to map[string]any
and extract its content directly using the submission's type to
determine the expected key.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* Fix flaky test by replacing time.After with m.Shutdown for synchronization
Replace the 1ms timing-based wait with pool.Close() via m.Shutdown,
consistent with all other tests in the file that rely on the same
background goroutine pattern.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
---------
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>1 parent 4499068 commit de0d81f
30 files changed
Lines changed: 3554 additions & 66 deletions
File tree
- .github/workflows
- cmd
- handler
- internal
- execution
- dispatcher
- supervisor
- worker
- server
- runtime
- schema
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
83 | 83 | | |
84 | 84 | | |
85 | 85 | | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
| 106 | + | |
| 107 | + | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
86 | 117 | | |
87 | 118 | | |
88 | 119 | | |
89 | | - | |
| 120 | + | |
90 | 121 | | |
91 | 122 | | |
92 | 123 | | |
| |||
123 | 154 | | |
124 | 155 | | |
125 | 156 | | |
126 | | - | |
| 157 | + | |
127 | 158 | | |
128 | 159 | | |
129 | 160 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
66 | 66 | | |
67 | 67 | | |
68 | 68 | | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
23 | 23 | | |
24 | 24 | | |
25 | 25 | | |
26 | | - | |
| 26 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
| 1 | + | |
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
| |||
18 | 18 | | |
19 | 19 | | |
20 | 20 | | |
21 | | - | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
22 | 24 | | |
23 | | - | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
24 | 79 | | |
| 80 | + | |
| 81 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
8 | 8 | | |
9 | 9 | | |
10 | 10 | | |
| 11 | + | |
11 | 12 | | |
12 | | - | |
| 13 | + | |
13 | 14 | | |
14 | 15 | | |
15 | 16 | | |
| |||
20 | 21 | | |
21 | 22 | | |
22 | 23 | | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
23 | 36 | | |
24 | 37 | | |
25 | 38 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
244 | 244 | | |
245 | 245 | | |
246 | 246 | | |
| 247 | + | |
| 248 | + | |
| 249 | + | |
| 250 | + | |
| 251 | + | |
| 252 | + | |
| 253 | + | |
| 254 | + | |
| 255 | + | |
| 256 | + | |
| 257 | + | |
| 258 | + | |
| 259 | + | |
| 260 | + | |
| 261 | + | |
| 262 | + | |
| 263 | + | |
| 264 | + | |
| 265 | + | |
| 266 | + | |
| 267 | + | |
| 268 | + | |
| 269 | + | |
| 270 | + | |
| 271 | + | |
| 272 | + | |
| 273 | + | |
| 274 | + | |
| 275 | + | |
| 276 | + | |
| 277 | + | |
| 278 | + | |
| 279 | + | |
| 280 | + | |
| 281 | + | |
| 282 | + | |
| 283 | + | |
| 284 | + | |
| 285 | + | |
| 286 | + | |
| 287 | + | |
| 288 | + | |
| 289 | + | |
| 290 | + | |
| 291 | + | |
| 292 | + | |
| 293 | + | |
| 294 | + | |
| 295 | + | |
| 296 | + | |
| 297 | + | |
| 298 | + | |
| 299 | + | |
| 300 | + | |
| 301 | + | |
| 302 | + | |
| 303 | + | |
| 304 | + | |
| 305 | + | |
| 306 | + | |
| 307 | + | |
| 308 | + | |
| 309 | + | |
| 310 | + | |
| 311 | + | |
| 312 | + | |
| 313 | + | |
| 314 | + | |
| 315 | + | |
| 316 | + | |
| 317 | + | |
| 318 | + | |
| 319 | + | |
| 320 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
139 | 139 | | |
140 | 140 | | |
141 | 141 | | |
| 142 | + | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
| 148 | + | |
| 149 | + | |
| 150 | + | |
| 151 | + | |
| 152 | + | |
| 153 | + | |
| 154 | + | |
| 155 | + | |
| 156 | + | |
| 157 | + | |
| 158 | + | |
| 159 | + | |
| 160 | + | |
| 161 | + | |
| 162 | + | |
| 163 | + | |
| 164 | + | |
| 165 | + | |
| 166 | + | |
| 167 | + | |
| 168 | + | |
| 169 | + | |
| 170 | + | |
| 171 | + | |
| 172 | + | |
| 173 | + | |
| 174 | + | |
| 175 | + | |
| 176 | + | |
| 177 | + | |
| 178 | + | |
| 179 | + | |
| 180 | + | |
| 181 | + | |
| 182 | + | |
| 183 | + | |
| 184 | + | |
| 185 | + | |
| 186 | + | |
| 187 | + | |
| 188 | + | |
| 189 | + | |
| 190 | + | |
| 191 | + | |
| 192 | + | |
| 193 | + | |
| 194 | + | |
| 195 | + | |
| 196 | + | |
| 197 | + | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
| 201 | + | |
| 202 | + | |
| 203 | + | |
| 204 | + | |
| 205 | + | |
| 206 | + | |
| 207 | + | |
| 208 | + | |
| 209 | + | |
142 | 210 | | |
143 | 211 | | |
144 | 212 | | |
| |||
263 | 331 | | |
264 | 332 | | |
265 | 333 | | |
| 334 | + | |
| 335 | + | |
| 336 | + | |
| 337 | + | |
| 338 | + | |
| 339 | + | |
| 340 | + | |
| 341 | + | |
| 342 | + | |
| 343 | + | |
| 344 | + | |
266 | 345 | | |
267 | 346 | | |
268 | 347 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
| 3 | + | |
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| |||
23 | 23 | | |
24 | 24 | | |
25 | 25 | | |
| 26 | + | |
26 | 27 | | |
| 28 | + | |
| 29 | + | |
27 | 30 | | |
28 | 31 | | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
29 | 39 | | |
30 | 40 | | |
31 | 41 | | |
| 42 | + | |
32 | 43 | | |
33 | 44 | | |
34 | 45 | | |
| |||
0 commit comments