Small hack for watching videos that don’t have subtitles

I find that comprehension massively improves for me when there are subtitles so I watch basically everything with subtitles now. Most things on Netflix typically have Japanese subtitles, but if you can’t find something on Netflix, I found it’s extremely rare for there to be Japanese subtitles.

For cases like these, what I do is download the video and then generate subtitles for it using OpenAI’s Whisper. I found that it is for the most part accurate (obviously not perfect) and is extremely helpful in increasing my comprehension.

There are paid products out there that can help you use Whisper transcription easily (I use MacWhisper, no affiliation). If you can’t afford it and are a bit technical, it’s really not hard to implement yourself at all. Here’s the Github (https://github.com/openai/whisper). I think you can run it straight from HuggingFace as well but I haven’t tried (https://huggingface.co/openai/whisper-large-v3). It runs entirely on device so you can create unlimited transcriptions and the data never leaves your computer.

Again, it’s not perfect, but I am extremely impressed by how accurate it ends up being most of the time and it’s definitely helping me understand more of what I watch. I find that my comprehension is almost always around 95%-100% with subtitles. Without subtitles, it varies greatly depending on the speaker, but usually around ~70%-80%, so this is a huge boost to me enjoying content that I otherwise would not be able to fully understand at my current level. Then again I also read a lot of novels so it’s particularly helpful for me to have text that accompanies audio. YMMV.

Hope this helps. I’m rewatching Sonny Boy right now and I’m finally catching lots of small details I missed the first time.

Leave a Reply
You May Also Like