> Their ladder (using public data, and hiring humans to classify) is still available I believe.
Not really. Once chatGPT came out, many sites changed their terms and/or significantly increased their API access costs to prevent/limit/make cost prohibitive future scraping.