Summary
Add a Groq provider adapter for fast inference with open models.
Details
Groq's API is OpenAI-compatible, so this could either extend a shared OpenAI-compatible base class or be a standalone adapter.
Requirements
- Create
src/providers/groq.ts implementing the ProviderAdapter interface
- Support streaming via SSE
- Register in
src/providers/factory.ts
- Add unit tests in
src/providers/groq.test.ts
Reference
Getting Started
See Adding a New Provider in the README.
Summary
Add a Groq provider adapter for fast inference with open models.
Details
Groq's API is OpenAI-compatible, so this could either extend a shared OpenAI-compatible base class or be a standalone adapter.
Requirements
src/providers/groq.tsimplementing theProviderAdapterinterfacesrc/providers/factory.tssrc/providers/groq.test.tsReference
src/providers/ollama.tsGetting Started
See Adding a New Provider in the README.