In my experience the NY ATC can be brusque in a way that can border on the unprofessional, and they tend to have an accent that can be hard to understand if you're not from there and you're listening on your crappy AM aviation radio. I assume that would go double for a non-native speaker of English.
In the rest of the country that I've flown in, the controllers seem to be aiming for the voice of bored Apollo mission controllers.