I’m not familiar with the Ancient Greek objections here, but I remember Renaissance scientists being hung up on this same thing.
They had measured the visible diameter of stars and without any parallax, would’ve also meant that the stars were absurdly large in addition to far away.
I don’t think they had a problem with the distance, per se, but the implied size.
(You have to treat stars as points - any perceived diameter is an illusion - but nobody knew that at the time.)