You can absolutely tune causal LLMs. In fact the original idea with GPTs was that you had to tune them before they'd be useful for anything.
You can also tune diffusion LLMs
After doing so, the diffusion LLM will be able to generate more tokens/sec during inference