Is there any good open source solution?
The current SIP clients try pretty hard to do things right in spite of the brokenness. You could try:
Mumble works well with very cheap and available servers but audio only.
If you want something really minimal and capable:
Riot UI is (still) confusing for new users.
https://wire.com is also open source but much simpler.
If it is, they hide it well.