You can't vote for a party and try to avoid taking the whole package deal. You get what you voted for.
Again: You get what you vote for. Using 'I disagree with what my party is doing, but I'm voting for them anyways' as an attempt to avoid criticism doesn't work. That's the nature of US politics. If you vote for one party despite them doing some heinous things, then you tacitly support what they're doing. If you don't like it, then either don't vote or vote for the opposite party.
But part of that compromise is that you accept the party is going to also do things you don't like. Which is something you can't escape criticism for. Voting is approval for that party. You're choosing to value what Party B does over Party A, which means you weigh the negatives of Party B as being less of a problem than the positives.
That doesn't mean you get to avoid those negatives when someone else calls you out on who you decided to throw your lot in with.