Regarding distractions, attention management is extremely important for AR, but has also been researched a lot. As long as we keep advertisers out of AR applications we'll be fine.
Not surprisingly, the military already uses it, and I doubt they'd give figher pilots AR helmets if a screen would be more efficient.