The restrictions instituted by normal property are grounded in the actual restrictions of physical reality. The restrictions instituted by 'intellectual property' have no such grounding.
> If I tell a guy my idea, and he implements it trivially with huge profit, then the loss is very real to me.
It is not real at all, and it justifies nothing.
If something is physically taken from you, you lose it -- whether there is any law or not. If someone else makes money, you lose nothing -- the idea of loss you present is entirely dependent on assuming there is a law supporting it. A law cannot be justified by itself; that is circular.