"You've imposed costs on us, because of all the effort we had to go to to show that you've imposed costs on us" ??
Assuming the other party is infringing your IP then it's reasonable and expected (depending on context, assuming you aren't the equivalent of a patent troll, etc) to demand that they stop. If they fail to comply then you litigate. For IP that's the case even if you don't directly suffer damages from their infringement.
Seeking reimbursement of legal expenses is also reasonable and expected (again assuming good faith).