Per California law the speed limit is supposed to be set at the 85th percentile of speed as measured by a traffic engineering study (operating speed), not the rate of travel the roadway was designed for (design speed).
The idea behind the law is that the majority of people are lawful, and that we are in fact "voting" for the right speed to be set by traveling at that rate.
Rather than creating lanes with no speed limit, we just need to force Caltrans and local municipalities to enforce this standard.