People interested in this might also be interested in transcribe-anything [1].

It automates video fetching and uses whisper to generate .srt, .vtt and .txt files.

[1] https://github.com/zackees/transcribe-anything