With signed content. Assuming you have a side channel for a one time joining process (email, SMS, real life etc) where you get a single use token/password etc you swap public keys and sign/encrypt all messages using it.