1. http://blog.wolfram.com/2007/05/computable_data_functions.html0
2. http://www.wolfram.com/products/mathematica/analysis/content/ProgrammingLanguages.html
So, mathematica is a beautiful language. It has symbols and pattern matching, so you can think more "mathematically." Loops exist too, and now aren't that slow, so you can think more like a computer. If you write mathematical code, the code you write is rendered in mathematical type, this is an amazing feature, and I'm glad Fortress is going to include it.
Pros aside, I've found mathematica hard to debug. The fact that the interpreter costs money is also a big minus. What are you thinking about writing in Mathematica?
It's an Open Source Python-based platform for mathematical and science development. The IPython shell is developed coincident to the platform, and is a great shell in and of itself (useful even if you aren't using SciPy, NumPy, or matplotlib). I don't know much about Mathematica or MatLab, as I don't actually do much scientific work...but I know that when I was working with the SciPy folks, there were a lot of converts coming from those platforms and ecstatic about the benefits of Python for this kind of work.