s/spaghetti & meatballs/illicit drugs/ and that argument falls apart. You will quickly lose other rights, even though drugs aren't explicitly guaranteed or prohibited by the constitution either.
(Not addressing GPs argument, just that the spaghetti & meatballs one doesn't hold water.)