It tends to matter a lot in two cases:
1. During development. Having instant builds running whenever you save is great for the development experience
2. For really large sites. Being able to build many thousand pages in about a minute instead of 20 minutes or way more is a huge difference for the authoring experience.