Having all of that built into the terminal is fantastic! The only feature I would ask for is obfuscation -- when I'm doing it for work, I am always careful that I change my question such that I get the right answer without revealing any company information.
Of course a solution to this is enabling someone to point at another model that they control, either locally or hosted privately.