The problem is, that in a P2P system you don't have only scammers that will not fulfill the trade. You also have careless people, who will mess something up, forget about the transaction, delete their clients/wallets, etc. With this schema, you are forcing the one party to take responsibility of stupidity of other.