Not necessarily. Some people are just less sensitive to latency, so even if a 20ms added delay might not be noticeable to you, it doesn't mean that other people won't feel it.