I wrote this Telegram bot that translates any video with AI-generated subtitles in about 2 minutes. You paste a YouTube, TikTok, or Instagram link, pick your language, and get back the video with burned-in subtitles.
It started because my wife watches Chinese dramas and new episodes never have subtitles for our language. Turns out thousands of people have the same problem — Arabic speakers watching anime, Russian speakers following Turkish series, Persian speakers catching up on K-dramas.
Supports 40+ languages, works with any video link or direct file upload. There's also a Mini App inside Telegram for a more visual experience.
Hey this looks cool but wanted to highlight a bug. I opened the bot, tapped on sample video and I got the “translating a sample Turkish drama…” message twice. Then it said “your first translation is ready” so I press view in the app and the recent list shows the duplication. It says the first one is ready but the second was in progress. I close the app and see a “our whale friend is gathering video” with a progress bar. So I guess it’s not ready? Then I get a failure message which looks like the second video failed? Anyway, cool idea but it seems buggy and I think the app UX could be simplified, good luck!
This looks cool, but what I'd really like is a self-hosted version that I could use to auto-subtitle videos I already have locally. This would help my language learning a great deal.
If any of you have already figured out a tool/workflow for this, I'd love to learn from your experience.
This thread prompted me to look into this. It seems that all I need is a thin wrapper around whisper-ctranslate2. So I wrote one and am playing with it right now.
I'm finding language auto-detection to be a bit wonky (for example, it repeatedly identified Ladykracher audio as English instead of German). I ended up having to force a language instead. The only show in my library where this approach doesn't work is Parlement[1], but I can live with that.
On the whole this is looking quite promising. Thanks for the idea.
[1] https://en.wikipedia.org/wiki/Parlement_(TV_series)