Speaking from first hand experience, it is possible to build efficiently without detailed specifications. The key is to put boundaries between different parts of the application and allow each developer to take full responsibility for delivering their part.

I've had some horrific experiences where multiple developers worked on the same features (without specs) while stepping on each others toes.