He's either on a leash (by law) pulling relentlessly, or he's free, needing vigilant watch. It's perfectly doable having him walk next to you, but he's still stressing out at everything and it seeps into your bones.
Might be many would benefit from taking walks like you do, I run instead, no patience for walking, but I probably should if only for the benefit of learning to be more patient.
The idea of doing something so unproductive and slow is really hard to get over, though.