This rule was enacted to prevent Alexander Hamilton from becoming president. He also wasn't born in the US. The term "naturalized" wasn't yet well defined.
The first American born president (born after the revolution) was Van Buren, the first 7 were born British citizens!