I'm not surprised, matrix is not easy or enjoyable to use at all; maybe the protocol itself is sound but every implementation I've tried both server and client is seriously bad