This line of reasoning works only in a static universe. In a expanding universe, stars can move apart faster than the speed of light. Thus there might be a lot beyond the observable universe that can never be detected.