I said "almost everyone". If you go to 1920s and ask a million people if humanity will be able to walk on the moon within their lifetimes, not a single one would say yes. And yet, we were able to do it. Similarly, we have been conceiving of interstellar travel for decades.
> Try a few dozen thousand years, my dude
With constant acceleration, ship time is very different. With constant acceleration using controlled nuclear fusion, we can do it in less than a century. Project Orion is not constant acceleration. Now before you point out issues in constant acceleration, remember that if you were in 1920s, you (and I) would also point out issues in moon landing. How can humanity ever leave Earth's gravity, go accurately to the moon, decelerate, LAND without crashing, walk, LAUNCH from moon again, go accurately to the earth, handle extreme atmospheric temps, and LAND without crashing.
Well, we did all of that. So surely, given a century, we can figure out interstellar travel.