You could store the address of the offending instruction/code sequence that generated the NaN (think software-only implementation).