Put another way: someone equally interested in frivolous arguments about the 1A could surely dig up “common sense” opinions from the 19th century about how blasphemy, obscenity, &c. are all reasonably excluded from the franchise. But that doesn’t make them correct.