You're not misunderstanding it - it was a giant power grab, and the federal government can say anything that affects interstate commerce is within their purview.