You'd have to self impose exile.

You are required to enter the US on your US passport if you have one.

If you wanted to go back (say to the funeral of a friend, or something equally important) then they could detain you until you paid what they thought was due.