This does not match my experience. Most new model architectures port fine to ONNX from pytorch, only occasionally having to fill in rare functions.
> Not even by a long-shot - first party compilers are generally faster because of smoother interop but even amongst third-party you have TRT and TVM.
Again, in my experience, there is little by way of documentation for any of these platforms nor as broad support for as many OS and Hardware combinations.
> I have no idea what anyone uses ONNX for these days
Huggingface has strong support for ONNX and leverages it for improved performance in places.
https://huggingface.co/docs/optimum/onnxruntime/usage_guides...
https://huggingface.co/docs/optimum/onnxruntime/usage_guides...
It's curious how impressions can differ so.