[WIP]: Add comprehensive video upload support to video analysis tools#16
Open
malay44 wants to merge 3 commits into
Open
[WIP]: Add comprehensive video upload support to video analysis tools#16malay44 wants to merge 3 commits into
malay44 wants to merge 3 commits into
Conversation
Created new video-upload.ts tool file to support local video file analysis and inline video data processing, keeping existing YouTube tools completely unchanged. New tools added: - gemini-analyze-video: Analyze local video files or inline video data - Supports videoPath parameter for local file paths - Supports videoData parameter for base64-encoded video content - Automatic file size handling (inline for <20MB, Files API for ≥20MB) - Video clipping support (startTime/endTime) - Media resolution control (low/medium/high) - Supported formats: MP4, MOV, AVI, MKV, WebM, FLV, WMV, M4V, MPG, MPEG, 3GP - gemini-summarize-video: Quick summarization for local video files - Multiple summary styles: brief, detailed, bullet-points, chapters - Same input flexibility as analyze-video Implementation details: - Created src/tools/video-upload.ts as completely separate tool - Registered new tools in server.ts without modifying existing code - Follows same patterns as document.ts and image-analyze.ts - YouTube analysis tools remain completely unchanged - Minimal impact on existing codebase Documentation: - Updated CLAUDE.md to version 0.8.2 - Added Video Upload as tool RLabs-Inc#12 (renumbered remaining tools) - Added comprehensive feature description - Updated Key Changes section https://claude.ai/code/session_01HEDNZqmLjK3QigJ8M4q6f3
malay44
force-pushed
the
claude/add-video-upload-support-TVGLG
branch
from
86ed2e2 to
9df502f
Compare
malay44
changed the title
…ey validation - Updated connection test to utilize models.get() instead of generateContent(), ensuring it does not consume generation quota. - Removed user model preference fallback, simplifying the connection process. - Improved logging to reflect the new connection method. This change enhances the efficiency of the API key validation process.
malay44
force-pushed
the
claude/add-video-upload-support-TVGLG
branch
from
92ac2b1 to
a1c8e36
Compare
Author
|
@acreeger can you review the changes? |
Contributor
|
@malay44 Can you take out the commit regarding the connection logic? Not saying it's incorrect, but it's a different issue - if the author of that commit wants to make a PR so @RodrigoLuglio can chime in, they should do so. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This supports multiple video input methods beyond YouTube URLs, including local video file uploads and inline base64-encoded video data. This brings full parity with Gemini API's official video input capabilities.
Key Changes
Multiple Video Input Methods
Smart File Handling
Expanded Format Support
Media Resolution Control
mediaResolutionparameter (low/medium/high) for all video input types