Wolfram's point, which is valid, is that ChatGPT can't do the damn math. That's simply not what it does. To do things like do accurate math, you need a different kind of model, one that is based on having actual facts about the world, generated by a process that is semantically linked to the world.
For example, Wolfram uses the example of asking ChatGPT the distance from Chicago to Tokyo; it gives an answer that looks plausible but is wrong. Wolfram Alpha gives the correct answer because, unlike ChatGPT, Wolfram Alpha has an internal store of facts that includes things like distances between major cities, and that store of facts was generated and curated based on, ultimately, someone actually checking the actual, physical distance from Chicago to Tokyo in the actual world.
Of course Wolfram adds to all this valid criticism the implicit claim that Wolfram Alpha is the panacea for all these problems, which is typical Wolfram hyperbole. But his basic criticism is still valid.