"No" is not confrontational. It's simply an answer to their quesion.