Openai's entire business model and product offerings are based on theft. Google's no saint, but the scale and scope are rather different. Furthermore, openai's shills spamming forums to defend the practice is unseen in intensity.
Inference is where things get more muddled. If I download a pirated copy of La La Land, that's illegal. However, if I watch it and then explain the plot of the movie to you in detail, that's fair use. It remains an open question whether or not inference via an LLM represents fair use or not.