Confuse is not the verb you are looking for. Repel is. You should have expected it would repel some people. Then, if it is an issue or not, that, is up to you to decide.