I started out with Audacity, went into ardour (whose development I still recurringly fund) and ended up in Reaper, which I can now whole-heartedly recommend given its extensive free available training material.
A long time ago I moved from GoldWave to Cool Edit (now Adobe Audition) then to Sound Forge.