Because we have zero evidence of it electromagnetically interacting. We have evidence of other particles like this, like neutrinos.
> Why can't it just be the equivalent of non-light-emitting asteroids and planets
Because they've been ruled out: https://en.wikipedia.org/wiki/Massive_compact_halo_object
You are not proposing anything new. Your ideas have been thought of before, and discarded because they lack evidence.
You are describing MACHOS, which was one hypothesis for dark matter. https://en.wikipedia.org/wiki/Massive_compact_halo_object
The thing is, we've looked for them. If they were small (asteroid sized), the amount required would be visible as dark clouds obscuring the objects behind them. If they were large (brown dwarf or bigger), we'd see gravitational lensing from them. We don't really see either of those on the scale required to explain the gravitational effect.
That implies far more evidence than actually exists. The science on the age of the Earth is far more grounded in experimental results simply because, well, we live on the Earth.
This doesn't mean CDM-L is incorrect in any way, but saying that questioning it is similar to being a YEC is ridiculous.
There's confident and there's cocky, I think you veered too much in one direction there.
Personally I'm still holding out the possibility of something like MOND being true, even if it looks more and more like it will have to coexist with DM at best. That doesn't stop me from noticing that most of the people who believe in it look exactly like cranks, and many of them actually are. And I'm going to keep pointing this out where it's relevant.