“We do know that the only way to find answers is by experiment and the only place to find them is where we haven’t been able to look yet.”
Further, it's an utterly superficial analogy. Physics 2020 is completely different than Physics 1894. We don't just have a complete understanding of the fundamental principles [1] underlying all terrestrial observations/experiments ever performed, but also a complete inventory of the involved matter. And we have had for decades.
[1] It's important to understand this in a strict reductionist way. Of course knowing the axioms is completely different from understanding their implications. And when studying their implication you are bound to encounter many novel principles not anticipated in the axioms. Thus even in the absence of what is by particle physicists "new physics" there is much to discover.