Its gotten to the point where the first thing I do when reading a paper is skim for their training data.
If its not from a public/standard/replicable data source my bullshit meter hops up a couple steps.
"We improved on the current SotA by 15% but you can't see the data or the code - but trust us, its for real"