Disagree.
A CLI is fundamentally for executing from the command line. Thus, embracing the power of the command shell is best practice.
If you want a human to see it, put it on stderr.
If you want a machine to see it, put it on stdout. Also I strongly agree with making it "structured" output. At minimum, a line-oriented record output is fairly easy to process downstream.
EDIT: If it is an interactive console application (REPL), then stdout is okay i guess.