Privacy and hallucinations would concern me. It seems likely to me that relying on these tools will mean physicians will "trust" the output of these systems and stop checking the notes for accuracy. Checking the notes will become a burden too.
Maybe the real solution is to lower the amount of administrative work required? Or hire people to do it?