I know Moonshine has released a model for this recently, https://huggingface.co/moonshine-ai/moonshine-es. They have lot's of examples. Maybe an evening with an coding agent will get you there.
oh cool! hadn't seen moonshine. Might actually try building something small on top of it. Thanks!