Complex numbers have 2 independent variables. The real and the imaginary parts. You can change one part without being forced to change the other. So you graph them perpendicular.
It's not really a convention, it's a rule that each independent variable is perpendicular (or else they aren't independent!). Complex numbers have 2 independent variables.