> No one is claiming this reasoning is analogous to human reasoning

The most prominent and deep-pocketed promoters of this tech — e.g. Musk and Altman — are constantly making this analogy.