There are millions of people in the Americas that don't speak English or Spanish. (Even ignoring the 200 million speakers of Brazilian Portuguese.)

If you combine just Mayan, Nahuatl, Mixtec, and Zapotec you're already in the millions.