The concern is twofold. First, chromium is an element and as such does not break down, it can only be secreted. Second, the higher oxidation state Cr(VI) is a known carcinogen. It's claimed the Cr(III) here will not oxidize to Cr(VI) under normal cooking conditions, however.

My understanding is the claim that Cr is a necessary micronutrient is disputed.