Does that sound about right?
There's really no substantive difference between that and what they're doing here, other than they're purposefully using a crappier model than GPT 3.5/ChatGPT to increase the cost savings.
For example, the first set of graphics is demonstrating switching a long question with 5 Q/A examples ("5-shot", in the literature) into ~4 sentences that are a paraphrasing of the question and have one or two very brief examples without reasoning.
That's all well and fine if you're confident the model is so amazing that it answers as well as it does with 1-shot as it does with 5-shot, but it is very, very, very likely that is not the case. Additionally, now you're adding this odd layer between the user's input and OpenAI that will easily be "felt".
It reads like a slightly garbled version of what someone writing down bullet point notes of a lecture might write.
It’s so rare that the human optimized and machine optimized versions of an input are so similar
The examples folder contain jupyter notebooks, there's also some videos and papers, while I just want to see an example text compressed