That which can be asserted without evidence can be dismissed without evidence.
The saying is simply the idea that someone can have a mental impression of something, and it defines how they see that something, regardless of the truth.
It doesn’t seem that controversial to me and certainly isn’t literal.