If the original model is poisoned then yes a checksum etc doesn’t matter. If you as the end user are being diligent then you are downloading the checksum and checking the download against it for precisely the scenario you talk about.
Personally I find it a bit exotic as I’d probably just stop trusting the vendor first but checking against a checksum does stop attacks where others alter an artifact.