Ask HN: Is meaningful ML research outside of major companies possible
And the larger costs are typically proportional to number of users etc, and so it can just scale with success.
Modern ML/deep learning/etc seems uniquely different in that it 1. Requires access to enormous datasets, and 2. Requires enormous amounts of compute to train (that second point is in contrast to the scalability point, one needs to perform that enormous upfront cost even for serving a single user).
1. Are any groups doing meaningful ML research without access to farms of H100? 2. Are freely available datasets as high quality as what might be available to larger companies?