> I assume this intended at a class which has already finished writing an AOT compiler and wants to build faster functions than you can derive at a compile time.

Quick answer just to this part: So the design challenge I was trying to solve here was doing AOT+JIT in one ugrad compilers class. This eats into some of the later assignments, but actually “worked”, in the sense that many students wrote first-call specialization.