whisper.cpp is optimized for Apple Silicon and is available as a Swift package

https://github.com/ggerganov/whisper.spm