No, if it's your money - not having a contract does not matter.

Imagine if a thief robbed your store, not having a contract with thief does not stop you from recovering theft amount from the thief.