In my experience not having a design system will produce so much overhead that investing in it early is warranted. It depends on how design-y your product is, though.
Some teams often say that it's not necessary before PMF, but I'm wondering how fast they ship without DS