Pipecat already does this. It does it for end of turn detection and it's pretty damn good. It's just that it calls the same LLM I have to do it, potentially expensive and prone to latency and not calibrated.