The danger isn't that the AI will gain sapience and decide to kill everyone, it's that people will assume that because an LLM could generate a reasonable overview of a large corpus of texts it can also drive a car, manage the power grid, detect l33t cyborhackors, calculate the optimum price for treasury securities, manage my retirement account or add numbers together.