Agreed, its the nature of science. That's why theory is so important and why physicists pay as much importance to non-experimental features like "beauty" when judging theories. Experiments cannot be trusted unless explained by theory!