How to Setup a Secure Private IRC Channel
botbot.me
botbot.me
First of all, it only takes one user connecting to your channel without SSL to render your encrypted connection worse than useless.
Secondly, if security and privacy are of utmost concern, then you should be running your own IRC server(s) in-house, thus allowing you more complete control and the ability to issue k-lines etc.
Second, if you insist on using a public IRC server a much better solution would be to use FiSH encryption (ultrx.net/doc/fish). Distribute the passkey over another channel to the users and you can have secure irc on a public network without even making the channel private. SSL also ceases to matter.