Not necessarily. QR systems such as Maxle are sturdy enough for competitive downhill use.
Also 10 pounds is a huge difference not just in the effort needed to propel the bike forward but also in terms of maneuverability, especially as it is rotating weight. And in city usage you often have to carry the bike down stairs etc. where again 5 kg and a messed up center of gravity is a big deal.