Bigger size means more latency. L1 needs to be fast due to frequent access. Is that what you mean by expensive?