Can you share more about how it was 'spooky'? Like it was completely unregulated?
So, no, it didn't dump hate speech on you or anything.
TBH I think the whole thing about making computers that basically pretend to be people is kinda awful on many levels, and that incident in the article is a big reason why.
While it is possible that more RLHF would improve it, let's not jump to the conclusion a bit too fast. Considering that you think that Google wouldn't have resources to fund it, a rather ludicrous notion.