Skip to content

feat. add lepton ai#1034

Merged
VisargD merged 5 commits into
Portkey-AI:mainfrom
Ajay-Satish-01:lepton
Apr 22, 2025
Merged

feat. add lepton ai#1034
VisargD merged 5 commits into
Portkey-AI:mainfrom
Ajay-Satish-01:lepton

Conversation

@Ajay-Satish-01
Copy link
Copy Markdown
Contributor

@Ajay-Satish-01 Ajay-Satish-01 commented Apr 12, 2025

Code Quality new feature

Author Description

Title:

  • Add Lepton AI support

Related Issues:

Title:

  • Add Lepton AI support

🔄 What Changed

  • Added Lepton AI as a new provider in the gateway
  • Implemented API configuration for Lepton endpoints
  • Added support for chat completion, text completion, and transcription services
  • Implemented stream handling for both chat and text completions

🔍 Impact of the Change

  • Expands the gateway's capabilities by integrating Lepton AI as a new provider
  • Allows users to access Lepton's AI services through the existing gateway interface
  • Follows established patterns for provider integration, ensuring consistency

📁 Total Files Changed

  • 7 files changed (495 additions, 0 deletions)
  • 2 files modified: globals.ts, providers/index.ts
  • 5 files added: providers/lepton/* (api.ts, chatComplete.ts, complete.ts, createTranscription.ts, index.ts)

🧪 Test Added

  • N/A

🔒 Security Vulnerabilities

  • No security vulnerabilities identified
  • Proper API key handling through Authorization header

Related Issues:

Quality Recommendations

  1. Add unit tests for the Lepton provider integration to ensure proper functionality

  2. Add error handling for edge cases in stream chunk parsing

  3. Add JSDoc comments to explain the purpose and parameters of key functions

  4. Consider adding validation for Lepton-specific parameters

  5. Add logging for API request failures to aid in debugging

Copy link
Copy Markdown
Member

@narengogi narengogi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, only one minor comment @Ajay-Satish-01

Comment thread src/providers/lepton/createTranscription.ts Outdated
@VisargD VisargD merged commit 4f68e8f into Portkey-AI:main Apr 22, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants