In general this is usually true, but simple non-switching regulators are quite common in electronics. They burn the excess energy as heat. In return the power supply has almost no ripple.