I have second guessed myself for years over this.
When we went to get drinks the first week, he told a co-worker that his wife is into horseback barrel racing. I saw some common ground and said how I used to do barrel racing when I was a kid and how it's a cool sport. He looked at me funny and said, "heh, I find that hard to picture/believe" or something like that.
In every interaction, I felt like I was being put down. Maybe he thought that criticizing everything I did was going to make me try harder, or suck up more, but for me it did the opposite. Encouragement is what makes me try harder.
I also had my own internal bias. I was the nerdy city slicker and he was the tough ex-military, country guy. I think we both projected stereotypes on each other.
I know I didn't do myself any favors with my behavior, but I continued out of principle.