But just so we're not arguing about the specifics of trademark law: I think you should throw away all your legal rights to a trademark if retaining those rights means you have to be a bad person.
In this case where both names are common English phrases, I think it's especially shady to be so aggressive about enforcement. I doubt either would win against the other, in fact, but I don't think it should come to that either.