As someone mentioned below, Google Voice can do this natively if you press a button during a call. It alerts the person on the other end of the line and makes a recording available in your account following the call. Quite useful and works on any phone provided you're using GV.