Feat/new model manager#2251

Draft

grzegorz-roboflow wants to merge 161 commits into

mainfrom

feat/new-model-manager

Commits on Apr 27, 2026

Commits on Apr 28, 2026

Wire v2 stubs: /v2/server/ready, /v2/server/info, /v2/server/metrics
grzegorz-roboflow
committed
/models/load -> /v2/models/load; /models/unload -> /v2/models/unload
grzegorz-roboflow
committed
split app.py
grzegorz-roboflow
committed
formatting
grzegorz-roboflow
committed
Add CLAUDE.local.md to .gitignore
grzegorz-roboflow
committed
adjust README to include installation; adjust pyproject.toml to enable installation of inference_models extras
grzegorz-roboflow
committed
wire /v2/models/interface
grzegorz-roboflow
committed
add lifecycle + dispatch tests
grzegorz-roboflow
committed
v2/models/infer step 1: response envelope + typed compact serialization
grzegorz-roboflow
committed
v2 structured error responses: error_response() helper, all v2 endpoints use it
grzegorz-roboflow
committed
v2/models/infer steps 2-4: structured errors, multipart form, JSON+base64 input
grzegorz-roboflow
committed
v2/models/infer step 5: URL-based image input via query param
grzegorz-roboflow
committed
v2/models/infer step 6: batch inference — concurrent slot alloc, multipart + JSON + URL batch
grzegorz-roboflow
committed
v2/models/infer step 7: rich format default, compact via ?style=compact, rich serializers for detection/classification/segmentation
grzegorz-roboflow
committed
formatting
grzegorz-roboflow
committed
Bump spool to 32MB as default, make it configurable via INFERENCE_MULTIPART_SPOOL_MB
grzegorz-roboflow
committed
cascade inference-models extras
grzegorz-roboflow
committed
fix
grzegorz-roboflow
committed
uv torch index routing for model_manager + server
grzegorz-roboflow
committed
remove uv sources from model_manager+server, index routing lives in inference_models only
grzegorz-roboflow
committed
capture empty body
grzegorz-roboflow
committed
fix: ASGI auth middleware (don't consume body stream), drop unused Depends
grzegorz-roboflow
committed
fix: lazy env init in state.py (fork race), ASGI auth middleware (no body buffer), skip empty slots in decode
grzegorz-roboflow
committed
fix: MMP creates ModelManager internally, single shared SHM pool, T_LOAD awaits completion
grzegorz-roboflow
committed
remove debug logs
grzegorz-roboflow
committed

Commits on Apr 30, 2026

Commits on May 1, 2026

Commits on May 12, 2026

Commits on May 13, 2026

Commits on May 14, 2026

Commits on May 18, 2026

Remove debugs
grzegorz-roboflow
committed

Commits on May 19, 2026