It's definitely about the words you used, whether I'm projecting or not. I didn't want to assume any ill intent on your side, so I answered in general.
Saying that the other party may 'call your bluff' implies that you're attempting to cheat them and hoping they won't notice. The word "bluff" is an euphemism for lies and deception. It's used positively in poker because the game rules allow it. But in real life "bluffing", i.e. deceiving and cheating, is frowned upon and often illegal.
The OP seems to have a relationship of trust with their partner and I'm urging him to keep it that way. I also meant it as a general business advice - it's important to keep friendly, trust-based relationships with people. Having to constantly look over your shoulder afraid of your co-founder stabbing you in the back, which is when phrase like "them calling your bluff" makes sense, is a lot of unnecessary trouble.