Edit and Continue in Visual Studio is similar to that.
You can change the source code while the program is paused in the debugger, for instance in a breakpoint, and continue after your modifications.
Do you get the ability to move the execution point back to before the the error, in order to resume execution? - from what I can tell, this isn't possible - from https://msdn.microsoft.com/library/y740d9d3.aspx#BKMK_Set_th...
"Setting the next statement causes the program counter to jump directly to the new location. Use this command with caution:"
"If you move the execution point backwards, intervening instructions are not undone. "
You can in Visual Studio 2012 and in Visual 2015 some corner cases were fixed.
Just drag the arrow backwards with the mouse.