Skip to content

[FEATURE]: Add AI-Powered Auto Subtitle Generator with Editable Timeline #1167

@Harini-2811

Description

@Harini-2811

Problem

Currently, users can edit videos directly in the browser, but adding subtitles/captions manually can be time-consuming and inefficient. Modern content creators rely heavily on captions for accessibility, engagement, and better viewer retention, especially for short-form videos.

Proposed Solution

Introduce an AI-powered Auto Subtitle Generator that automatically converts speech from uploaded videos into editable subtitles.

The feature can include:

  • Automatic speech-to-text subtitle generation
  • Subtitle blocks displayed on the video timeline
  • Editable subtitle text and timing
  • Export support for subtitle formats like .srt and .vtt
  • Real-time subtitle preview inside the editor

Benefits

  • Improves accessibility for viewers
  • Helps creators produce content faster
  • Increases engagement for social media videos
  • Makes the editor more feature-rich and modern

Possible Implementation

  • Extract audio from uploaded videos
  • Use Whisper API/local speech-to-text model
  • Render subtitles as editable timeline segments
  • Sync subtitles with video playback

Expected Impact

This feature would significantly improve the usability of the platform for content creators, educators, and video editors while keeping the editing workflow completely browser-based and user-friendly.

Metadata

Metadata

Assignees

Labels

enhancementImprovement to existing functionalityfeatureNew feature requesttype:featureNew feature

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions