Apps like Notability [0] do this very well these days. You can combine text, pen and audio input, though I'm not sure if the audio is synchronized.

-

[0] http://gingerlabs.com/