More than once I've had a long document open and I've been like, oh Edge has GPT now maybe it can give me a summary. It will read the page, produce something vague, I'll ask a follow up question and it will completely lose track of what we're doing and like search Bing for generic information not at all related to the webpage I'm on. It also seems inherently unable to say, "oh the page doesn't include that information" rather it just makes things up so I always end up just having to read the document myself.
It really feels like an LLM being slapped on for the sake of having one rather than trying to solve a real need. Which is super frustrating because I have a real need and this technology in theory could solve it.