I use Octave daily (in the last hour, will return to it when I finish my soup), but have never seen anything that matched Mathematica's symbolic/pure math functionality.

Will check out Sage, haven't used Maxima since 2004. Thanks!

Edit: Sage looks nifty, Maxima looks unchanged, at least at screenshot-level.