> The only way to then exit is Ctrl-D

Nope.

  >>> __builtins__.exit()