Skip to content

Latest commit

 

History

History
9 lines (5 loc) · 335 Bytes

File metadata and controls

9 lines (5 loc) · 335 Bytes

Dynamo frontend node.

Usage: python -m dynamo.frontend [--http-port 8000].

This runs an OpenAI compliant HTTP server, a pre-processor, and a router in a single process. Engines / workers are auto-discovered when they call register_llm.

Requires etcd and nats-server -js.

This is the same as dynamo-run in=http out=dyn.