Obviously Von Neumann probes haven't blanketed the galaxy as if they had, it would be obvious. Not to belabor a point I made in another comment, but the Fermi Paradox is a harsh taskmaster.
So this leaves a few possibilities:
1) No intelligent, technologically advanced civilization exists in the universe other than ourselves, because any such civilization would have developed Von Neumann probes, which would mean the galaxy should be covered by them.
2) No intelligent, technologically advanced civilization has yet developed Von Neumann probes.
3) Von Neumann probes exist, but they haven't blanketed the galaxy. Since the math says it should be easy for them to do so, either they were developed relatively recently and simply haven't had the chance to do so, or else confounding factors exist which make the process of unbounded exponential growth more difficult than the math would suggest.
None of these possibilities lead to the conclusion that UFOs (assuming the narrative presented by Grusch and other UFO believers) as described are more likely to be Von Neumann probes than not.
Any nearby civilization that released millions of self-replicating probes should be noticeable. We've studied nearby stars, there's no evidence of any of the telltale signs of energy usage or heat that should accompany something on that scale.
Also, there's no evidence of replication on the part of these objects within the UFO narrative. What are they feeding on? Where? Exponential replication means if they're here they should have stripped our solar system clean by now. Why haven't they?
All of the behavior described resembles conventional, piloted craft rather than the expected behavior of swarms of Von Neumann probes.