Only in private. Copyright law can give the owner exclusive rights to perform a song publicly. If the lawyers can convince a judge that your singing counts as a public performance you can end up on the hook for not getting or being covered under a performance license.
https://lawwithmiller.com/blogs/copyrights/cover-me-im-legal...
https://en.wikipedia.org/wiki/Right_to_quote
I think your copyright argument is focused on media, like music. This appears be a specific exception that applies to text. Music sampling for example is a direct copy of the recording but quoting text, even though it's a copy, is a new work because although the words are the same it's not the original copied (as in the quote is written or typed by OpenAI).
Because if you ask for an opinion on a subject it generates new information itself based on the data gathered.
It does sometimes quote sources, which are properly noted and attributed, but how is that wrong? People write books (for money) all the time and reference sources.
I'm not understanding why you think the LLM is different from a person in how it uses information to produce new work.