The one mineral I rarely hear about when talking about a vegetarian or vegan diet is Zinc. It is nearly impossible to get enough Zinc without eating animal products. You can either eat nearly 3 pounds of peas, or little more than .5 ounces of canned oysters to get enough Zinc in your diet. Being low on Zinc weakens your immune system, and your libido, so yeah - it's important.
YMMV, but I am feeling much better now that I've made it a point to eat more (local, organically-raised) meat.