Not anymore. There's arguably more than enough data to form a base for strong LLMs; extra data is nice, but doesn't have to come in such quantity.
(In fact, there's value in trying to filter excess crap out of existing training sets.)
(In fact, there's value in trying to filter excess crap out of existing training sets.)
What happens when you need to search something new? Just hallucinations all the way down?