Just a thought: maybe space is not sparsely populated with bits of stars and rocks. Space is filled with a form of matter we cannot yet detect.
Of course, future generations will find some sort of new matter, or some form of new interaction, but what you're saying doesn't mean anything for our world today.