Of course developers prefer faster build times. But what do the end-users who you write code for prefer? (Especially in a typical CI/CD environment where developers often don't need to monitor and wait for builds to finish)
2% sounds small. And it is, if your traffic is small. It's not small when you have millions of users.