High-quality data is the best compute multiplier

datologyai.com

10 pointshurrycane2 comments

Huh, you can now buy frontier lab quality data?

It’s great to see someone focusing pretraining data and not just post training. It's probably a harder problem.

Yeah! This is so underrated relative to the overall impact.