They all keep them on their key chain so I don't agree with your premise.
The only thing I never understand is why, like the device pictured, they're designed with strings and thin plastic instead of chains and a beefy case.
The key to this is to still require something that you remember like your username (and/or a password), they will get stolen and it is too risky for these tokens to be the only authentication factor.
As long as users are educated that these tokens should in all ways be considered a set of keys then security can only be improved with them.
Of course, people still leave the key at the computer when they go and eat, bathroom, or when they leave the building as a group.
For work purposes, i.e. you need it to do your job so it may be required at any point. TFA is saying people will leave it just by the PC they use most often, i.e. at home, which defeats the point.
I think the use of smart phones for 2-factor is the way to go, since it is not something else I need to carry around. Up until recently Barclays Bank (in the UK) had a fairly bulky card reader which I would insert my card, tap in my pin and it would generate a secondary password (I also have to chose letter X and Y from my password). They now have a smart phone app. Much simpler for me now.