>> Is taking your hands off the steering wheel much better?

Yes. Most drivers are able to drive using one hand for a short period of time. Not so with eyes off the road.

In fact, it's a requirement in most countries where stick shift is the norm.