> [...] they would have incentive to not let you go

This is where separation of powers is important. A judiciary shouldn't care that the executive branch is on the hook for compensation.