There is an iPad app called AudioNote that does what you describe:

http://itunes.apple.com/us/app/audionote-notepad-voice-recor...

I haven't tried it yet, but I think I'll grab the free version and give it a whirl.