People who think that intelligence is innate will refer to the "g factor". http://en.wikipedia.org/wiki/G_factor_%28psychometrics%29
The racist (technically speaking) and controversial Jean Rushton believes that "gains in IQ over time (the Lynn-Flynn effect) are unrelated to g".
What's really going on with discussions like this is that humanity seems to have come to the conclusion that "smarter is better". Intelligence almost certainly exists, but is quite difficult to quantify exactly, and is further complicated by the fact that people resent others who are "better" than them. Given that there is a genetic component to intelligence to a certain degree, race becomes a factor and leads to a line of inductive reasoning that makes people uncomfortable:
1) Smarter is better
2) Intelligence is genetic
3) Race determines genetics
4) One race is better than another
5) Hitler was right (or other outrageous conclusion)
As far as I can tell when you see terms like "g factor", "Flynn effect", "multiple intelligences", "crystallized intelligence", "fluid intelligence", "cultural fair IQ tests", "The bell curve"... people are really secretly arguing about one race or sex being smarter than the other, or not.