I don't think it's an efficiency core thing. On ~the same machine (I have a smaller SSD, but otherwise identical):
> time make -j
real 0m8.716s
user 0m29.786s
sys 0m15.102s
> time taskpolicy -c background make -j
real 0m42.196s
user 1m13.041s
sys 0m30.957s
(The latter command forces use of the efficiency cores, the former is allowed use everything)
One thing that _is_ notable is that it isn't really managing great parallelism (particularly visible in the efficiency core one).
(Only looking at the actual build, as IME autoconf has remained reassuringly slow for the last 20 years, in defiance of all progress in CPUs, so I'm not at all surprised by that one...)