There are real time requirements on the protocol handling so you can't just send "raw" L1 transport blocks up to the AP.
Anyway, the real question is: Can you build a 4G radio you can trust because it does little enough that it can have open firmware and driver and protocol software that takes less than 10 years to write? I think the answer is "Yes. Maybe simpler than 2G." Or at least "Much more likely than with a 3G radio."