Meta ironically unveiled just this thing. An AI model that can translate in <2 seconds intended for use in real time conversation.

https://ai.meta.com/research/seamless-communication/