Is there any prior work on how to integrate a LLM with something as primitive as a simple calculator? I suspect it's hard. Does ChatGPT even know what question to ask? Integrating LLM's with logic/reasoning/computation seems important, but I wonder if it's a ways off?

I doubt anyone would bother integration with Wolfram except for Wolfram, though.