Take him to court before he can take you. This will give you the better position and he will probably get scared and settle.