add feat. kluster_ai#1082
Conversation
|
Important PR Review SkippedPR review skipped as per the configuration setting. Run a manually review by commenting /matter review 💡Tips to use Matter AICommand List
|
|
Summary By MatterAI
🔄 What ChangedThis PR adds support for a new provider called Kluster AI to the system. The implementation includes API configuration, chat completion, embedding, and file upload functionality. The provider is registered in the global constants and added to the list of valid providers. 🔍 Impact of the ChangeThis change extends the system's capabilities by integrating with Kluster AI's API, allowing users to use Kluster AI models for chat completions and embeddings. The implementation follows the same pattern as other providers in the system, making it consistent with the existing architecture. 📁 Total Files Changed
🧪 Test AddedN/A - No tests were included in this PR. 🔒Security VulnerabilitiesN/A - No security vulnerabilities were identified in the implementation. MotivationTo expand the platform's capabilities by integrating with Kluster AI's services, providing users with more model options for chat completions and embeddings. Type of Change
How Has This Been Tested?
Screenshots (if applicable)N/A Checklist
Related IssuesN/A Sequence DiagramsequenceDiagram
participant Client
participant Provider
participant KlusterAIConfig
participant KlusterAIAPIConfig
participant KlusterAIChatComplete
participant KlusterAIEmbed
participant KlusterAIUploadFile
participant KlusterAI_API
Client->>Provider: Request with provider=KLUSTER_AI
Provider->>KlusterAIConfig: Load provider configuration
KlusterAIConfig->>KlusterAIAPIConfig: Get API configuration
KlusterAIAPIConfig-->>KlusterAIConfig: Return baseURL, headers, endpoints
alt chatComplete function
Client->>KlusterAIChatComplete: Request chat completion
KlusterAIChatComplete->>KlusterAI_API: POST /chat/completions
Note over KlusterAIChatComplete,KlusterAI_API: Params: model, messages, temperature, etc.
KlusterAI_API-->>KlusterAIChatComplete: Response
KlusterAIChatComplete->>KlusterAIResponseTransform: Transform response
KlusterAIResponseTransform-->>Client: Return formatted response
else embed function
Client->>KlusterAIEmbed: Request embeddings
KlusterAIEmbed->>KlusterAI_API: POST /embeddings
Note over KlusterAIEmbed,KlusterAI_API: Params: model, input
KlusterAI_API-->>KlusterAIEmbed: Response
KlusterAIEmbed->>KlusterAIEmbedResponseTransform: Transform response
KlusterAIEmbedResponseTransform-->>Client: Return formatted response
else uploadFile function
Client->>KlusterAIUploadFile: Upload file
KlusterAIUploadFile->>KlusterAIRequestTransform: Transform request
KlusterAIRequestTransform->>KlusterAI_API: POST /files
KlusterAI_API-->>KlusterAIUploadFile: Response
KlusterAIUploadFile-->>Client: Return response
end
|
|
@VisargD @vrushankportkey is it possible to review this PR? |
|
Important PR Review SkippedPR review skipped as per the configuration setting. Run a manually review by commenting /matter review 💡Tips to use Matter AICommand List
|
|
Summary By MatterAI
🔄 What Changed
🔍 Impact of the Change
📁 Total Files Changed
🧪 Test Added
🔒 Security Vulnerabilities
Type of Change
Checklist
Sequence DiagramsequenceDiagram
participant KlusterAIConfig as Config
participant KlusterAIAPIConfig as API
participant ChatComplete as Chat
participant Embed as EmbedService
Config->>API: Configure API Settings
Config->>Chat: Configure ChatComplete Params
Chat-->>Config: Set Model 'Meta-Llama-3.1-8B-Instruct-Turbo'
Config->>EmbedService: Configure Embedding
EmbedService-->>Config: Set Model 'Meta-Llama-3.1-8B-Instruct-Turbo'
Note over Config: Configures Response & Request Transforms
|
|
Important PR Review SkippedPR review skipped as per the configuration setting. Run a manually review by commenting /matter review 💡Tips to use Matter AICommand List
|
|
Summary By MatterAI
🔄 What Changed
🔍 Impact of the Change
📁 Total Files Changed
🧪 Test Added
🔒 Security Vulnerabilities
DescriptionKluster AI Integration Pull Request Type of Change
How Has This Been Tested?
Checklist
Sequence DiagramsequenceDiagram
participant Developer
participant GitHub
participant KlusterAI
Developer->>GitHub: Create Pull Request
GitHub->>KlusterAI: Trigger Integration
KlusterAI-->>GitHub: Process Request
GitHub-->>Developer: Update PR Status
|
|
Hi @Ajay-Satish-01 , sorry for the delay. I have added few more comments. And can you please also resolve the merge conflicts? |
|
DescriptionSummary By MatterAI
🔄 What ChangedThis pull request introduces the integration of Kluster AI as a new AI provider. Key changes include:
🔍 Impact of the ChangeThis change significantly expands the platform's capabilities by adding support for Kluster AI services, allowing applications to utilize Kluster AI for chat completions, embeddings, and file uploads. It follows the existing provider integration pattern, ensuring consistency. However, a critical bug exists where the 📁 Total Files Changed6 files changed. 🧪 Test AddedNo explicit unit or integration tests were added in this pull request. The functionality would require manual verification. 🔒Security VulnerabilitiesNo new security vulnerabilities were detected in the provided code changes. The API key handling uses a standard Bearer token approach, which is appropriate. MotivationIntegration of Kluster AI as a new provider to expand supported AI services and offer more options to users. Type of Change
How Has This Been Tested?
Screenshots (if applicable)N/A Checklist
Related Issues. Tip Quality Recommendations
Sequence DiagramsequenceDiagram
participant App as Application
participant Globals as src/globals.ts
participant ProvidersIndex as src/providers/index.ts
participant KlusterAIConfig as src/providers/kluster-ai/index.ts
participant KlusterAIAPI as src/providers/kluster-ai/api.ts
participant KlusterAIChatTransform as src/providers/kluster-ai/chatComplete.ts
participant KlusterAIUploadTransform as src/providers/kluster-ai/uploadFile.ts
participant OpenAIUtils as src/providers/openai/utils.ts
participant KlusterAIApiEndpoint as Kluster AI API (https://api.kluster.ai/v1)
App->>ProvidersIndex: Request Kluster AI service (e.g., chatComplete, embed, uploadFile)
ProvidersIndex-->>KlusterAIConfig: Provides KlusterAIConfig
KlusterAIConfig->>KlusterAIAPI: Get API config (fn: chatComplete, embed, uploadFile)
KlusterAIAPI-->>KlusterAIConfig: Returns base URL, headers (Authorization: Bearer apiKey), endpoint (/chat/completions, /embeddings, /files)
alt For chatComplete or embed
KlusterAIConfig->>KlusterAIApiEndpoint: HTTP Request (POST /chat/completions or /embeddings)
KlusterAIApiEndpoint-->>KlusterAIConfig: API Response (ChatCompletionResponse | ErrorResponse)
KlusterAIConfig->>KlusterAIChatTransform: Transform Response (response, responseStatus)
KlusterAIChatTransform->>OpenAIUtils: Call OpenAIErrorResponseTransform (if error)
OpenAIUtils-->>KlusterAIChatTransform: Transformed Error Response
KlusterAIChatTransform-->>App: Returns ChatCompletionResponse | ErrorResponse
end
alt For uploadFile
App->>KlusterAIUploadTransform: Prepare Request Body (requestBody: ReadableStream)
KlusterAIUploadTransform-->>KlusterAIConfig: Returns transformed requestBody (currently passthrough)
KlusterAIConfig->>KlusterAIApiEndpoint: HTTP Request (POST /files)
KlusterAIApiEndpoint-->>KlusterAIConfig: API Response
KlusterAIConfig->>KlusterAIChatTransform: Transform Response (response, responseStatus) - Note: This transform is designed for chat completions.
KlusterAIChatTransform->>OpenAIUtils: Call OpenAIErrorResponseTransform (if error)
OpenAIUtils-->>KlusterAIChatTransform: Transformed Error Response
KlusterAIChatTransform-->>App: Returns Upload File Response | ErrorResponse
end
Globals->>KlusterAIConfig: Provides KLUSTER_AI constant
KlusterAIConfig->>Globals: Adds KLUSTER_AI to VALID_PROVIDERS
|
|
Important PR Review SkippedPR review skipped as per the configuration setting. Run a manually review by commenting /matter review 💡Tips to use Matter AICommand List
|
|
Important PR Review SkippedPR review skipped as per the configuration setting. Run a manually review by commenting /matter review 💡Tips to use Matter AICommand List
|
|
Important PR Review SkippedPR review skipped as per the configuration setting. Run a manually review by commenting /matter review 💡Tips to use Matter AICommand List
|
|
Important PR Review SkippedPR review skipped as per the configuration setting. Run a manually review by commenting /matter review 💡Tips to use Matter AICommand List
|
|
Important PR Review SkippedPR review skipped as per the configuration setting. Run a manually review by commenting /matter review 💡Tips to use Matter AICommand List
|
|
Important PR Review SkippedPR review skipped as per the configuration setting. Run a manually review by commenting /matter review 💡Tips to use Matter AICommand List
|
|
@VisargD Please review this PR when you get time :) |
|
Important PR Review SkippedPR review skipped as per the configuration setting. Run a manually review by commenting /matter review 💡Tips to use Matter AICommand List
|
3 participants
Description
Added Kluster AI integration
Type of Change
Related Issues
#1069