Use a Pseudoinverse or a decomposition instead. A great book to read is Matrix Computations by Golub/van Loan.