Indeed, although I would wager that current CS programs don't effectively gauge that either.

I think part of what's interesting is that there is this massive proliferation of non-college sources of education for CS, but none of them seem to have the clout and accreditation that a lot of employers look for. So why aren't universities copying the coding bootcamp model as a hybrid with CBE? I hope it's not just because they're being sticks in the mud.

I don't know whether or not judging programming ability is hard. But judging ability in computer science, which is what we're talking about, is not at all "very hard".