I read this as "if it is on the stack and looks like a reference when you squint your eyes, then we treat it as a reference" compared to objects on the heap where the GC seems to know the exact location of all references.
Scanning the entire heap is different because of its generally much bigger size. It's far more likely then to see references where there are none.