My LA teacher in college told us that he visualized the left matrix in a matrix multiplication flipping over and crashing down on top of the right matrix. (or is that backwards?) The only way I learned things like vector spaces and orthogonality was by visualizing them in my head, Bret-Victor style.
In my totally unqualified opinion, there is a huge opportunity for a software product that allows people to play with and explore mathematical concepts in a visual and fun way.