A big difference is that we know for a fact that psychedelic mushrooms were around back then -- they didn't spring into existence in the last couple thousand years.
(Even if a mushroom or proof of its usage was found nearby. Rock art specialists have found that dating rock art by the surrounding context is not the correct technique. As newer methodology has found that the surrounding context can lead to dating thousands of years off. It’s best to date the art directly)