A GUI for real-time transcription and translation of YouTube/Twitch/IPTV streams

[antor44]

Hi everyone,

I wanted to share an app I've been working on since May 17, 2023. It uses whisper.cpp under the hood to transcribe live video streams in real-time.

🔗 GitHub Repo: livestream_video / playlist4whisper

It comes with a Python GUI designed to make it easy to watch foreign streams, manage playlists, or generate subtitles without having to type complex command lines every time.

Here is what you can do with it:

• Live Transcription: It captures audio from YouTube, Twitch, or IPTV (using yt-dlp/streamlink) and feeds it into whisper-cli while you watch the video.
• Live Translation: It translates the text on the fly. I recently added support for the Gemini API, so it uses context to provide much better grammar than standard line-by-line translators.
• Timeshift Support: You can pause or rewind live streams (using VLC) and the transcription will stay synced.
• SRT Generation: You can also use it to auto-generate .srt subtitle files for your local audio/video files.

I hope some of you find it useful for watching streams or managing your local media!