Interested also, which text-to-speech model do you use?
For diarisation Granola uses a chrome extension instead of a bot if that can give you ideas.
Ahh yea as for the models:
Speech to text - Nvidia Parakeet TDT 0.6b V3
Diarisation - Nvidia Marblenet for the speech detection, TitaNet-Large for the embeddings and then using NeMo multi-scale to do clustering around them