Not at all a silly argument. The human species is extremely bad at understanding the delicate balance the nature is in and extremely bad at estimating how much we know about nature. We don’t even know all the insect species that exist, yet we are comfortable telling others that they will find other similar food.
It’s the kind of confidence aliens would have observing humans eating lettuce and assuming we’d be fine with grazing grass if they take all the leafy vegetables away.