Is it significant when you are talking about analytical queries which are running for minutes or hours? Seems like it wouldn't be a huge amount of code to JIT compared to the payoff?
But you are absolutely correct that for long running analytic queries, the up front cost of generating optimized code pays off.