Completely agree, ARM is where it's at.
Recipe for an open source, GCC-based ARM toolchain:
-GCC
-Newlib (an implementation of the C standard library aimed at embedded systems)
-Binutils
-GDB (optional; great if you pick up a jtag debugger and openOCD)
I pushed out a cross-compiler via this recipe that survived an entire semester of usage in labs along with an ARM Cortex-M3 board.
No limitations on RAM usage, full optimizations available. As far as I've seen, GCC does a nice job using the ARM thumb2 instruction set when you enable optimizations.
I felt compelled to put together my own linker script; one of the more painful parts. I'm not sure if the default linker script will work or not.
I've been meaning to put this toolchain recipe online somewhere, along with a tool I put together for flashing the GCC-produced executables to the Cortex-M3 via USB DFU.