Look into deepseek's papers. They have done some stuff recently about improving inference and it seems to be how they can sell tokens so cheap.