You need a signaling channel to your peer. This doesn't have to be a server, but it makes things simpler.