The way biology evolves to adapt is also very shortsighted! Even without long-term planning, it can still make spiders!
Something akin to venture capital, where it makes many, many tries most of which fail and the occasional success moves the field forward.
Presumably investors want more reliable returns from mature companies.