Most hyperthermophilic archaea die well below many bacterial sporulation temperatures already. Additionally, most hyperthermophilic organisms can't live at body temperature, as that's too low, let alone reproduce AND fight off a host immune system. Prions are a special case and not particularly virulent because they aren't genetically tractable.