Julia's math library is starting to shape up:
http://docs.julialang.org/en/latest/stdlib/base/#mathematica...
It even has a digamma, Riemann zeta, and Bessel functions with fractional orders, which you won't find in Excel.
The statistics built-ins are a bit weak, however.