What's to stop the factory to cut you out and just sell on Amazon?

That's why many folks use freight forwarders who break out, wrap, label, and send the items to Amazon.