I would guess, since Asimov was a pretty smart fellow who understood this stuff pretty well, that the original statement was more along the lines of saying how great it was to live in an age where so many fundamental things about the universe are now understood. Things like relativity and quantum mechanics may be superseded by new things, but they'll remain fairly accurate understandings of what they're meant to describe, analogous to the spherical earth he mentions later.
The arguments back and forth on this fascinate me. On one hand, on some scales, Newtonian mechanics is "correct enough" to give results that work, and so in that sense it is just "incomplete" in that its domain is restricted. On the other, relativity and QM change everything. These new theories may reduce to Newtonian mechanics given certain assumptions, but Newtonian physics says things about the structure of spacetime that are incorrect (e.g. velocity is not additive). In this sense, one can fairly say that Newton's mechanics are not just incomplete, but wrong.