I confess I am an impatient reader, and many non-fiction titles I read feel padded out with unnecessary verbiage. I do wonder if the tools we use to write have some bearing on this. When using a computer to write, the ease of editing means it's much easier to just write and write and write.
Imagine if you were forced to write your manuscript by hand. I'm guessing the length of your non-fiction manuscript would be shorter, sharper and more to the point.