State law may also impose additional requirements, as for example in California where the training must be part of an official educational curriculum at an accredited school - California imposes other restrictions as well.
All in all, the rules may be well-meaning but they effectively kill opportunities for students to get training in many situations where the employer would otherwise normally be glad to make the opportunities available. In practical terms, it means that an employer wanting to open opportunities to students needs to pay minimum wage at least. Of course, the idea of the regulations is to prevent employers from circumventing minimum wage rules by dressing up what is really a job as an "internship" and in this sense they serve a protective function.
Mark Cuban once did a piece entitled "Want an Unpaid Internship So You Can Get Valuable Experience - Screw You" (http://blogmaverick.com/2009/09/05/want-an-unpaid-internship...) in which he recounted his frustrations in dealing with the federal regulations, and this in turn elicited an interesting and lively thread here at HN (http://news.ycombinator.com/item?id=806563).