I would worry about the legitimacy of any MS in CS program that did not make someone without a CS undergrad degree take significant remedial coursework.
Also, there is an element of selection bias. Those who are likely to apply to an MS in Computer Science self-select according to their perception of the requirements of those programs. This enables programs to capture those without a Bachelor's degree in Computer Science but who still have the level of motivation, acumen, and interest necessary to succeed in an MS program in Computer Science.
So long as they know the fundamentals of programming (through, say, the equivalent a Data Structures class) I think a mathematician could take a go at it without much issue. An EE probably wouldn't have too much trouble either.