> I wonder how much we are learning with these studies about what is going on.
So your alternative is to not have any studies and everyone can just stump up anecdata as "evidence" for the capabilities of these models?
So your alternative is to not have any studies and everyone can just stump up anecdata as "evidence" for the capabilities of these models?
Regardless, your assertion that "oh well, the models will be totally different in a few months anyway, therefore any study done today is pointless" seems more than a stretch. How do you know they will be so different? How can you verify that today's studies are completely irrelevant?