Unfortunately, neither VLLM nor TGI support FP8 on AMD yet. But once they do, we will look into it.