Not at all. The person asking for attention will communicate what topic they want to discuss. I can then evaluate if that topic is more important than whatever I am working or focused on. If I tell the person that they need to wait, they could tell me why I am not doing my priority evaluation correctly and then I’ll reassess. There is no conflict or lack of politeness. The system works well for our team.