The first one will be much bumpier and tiresome than the second for any given speed, and you'll be at a higher risk of injury due to careless step. And the benefit of having a flat surface is greater the more rugged is the terrain that must be crossed. This is why, though the Incas didn't use the wheel, they had roads nonetheless. And the Romans, too, built their own roads mainly for the speedier movement of their armies while on the march.
I mean, didn't "streets" emerge really from commonly-travelled paths carved by feet and horse hooves and time, and really most non-paved paths are quite fine for most wheels? Perhaps they last longer on pavement, but other than that..
The Roman empire made good use for it with their armies (of course, also for trade) and Roman soldiers were mostly on foot and a few on horses.