78 karma · joined March 11, 2022
Also launching pinch.now (main quest) -- which provides instant real-time interpretation for any chrome tab or online meeting.
If anyone finds this useful I'll probably add some parsing for non-text formats like PDF, images, videos.
Also in case you're interested in the logistics of using us for livestreaming: If our current platform won't work for your use-case and you need to use OBS + a virtual camera, it's on our roadmap.
From the technical side, speech to speech models have more potential for accuracy (no explicit ASR, no audio->text information loss). We have a few options on mimic'ing nonverbal elements - we could decide when to naturally mix in the original audio, or train our end to end model to handle those nonverbal audio chunks. We'll be trying both but likely the first option on the sooner side!