"They can be interesting to think about, but without any evidence for them there isn't any reason to give them particular consideration. (I am including rational, mathematical, or logical arguments based on experimental evidence as evidence here)"
I'm glad we're discussing this because you're an example of the kind of thinking that is a mystery to me.
The fact that I have qualia when looking at, for example, the color yellow, is directly knowable by means of just a little introspection. This is not "rational, mathematical, or logical" or based on "experimental evidence". It is simply direct observation. Observation is where the scientific processes you name start. Observation does not depend on those processes. They depend on it and build from it. Observations are the most fundamental thing.
From the direct observation of your experience of yellowness, which I think you must agree is something more than merely classifying the wavelength as being in a certain range, I would think you would know that qualia exist. That is enough evidence.
"How do we decide what the actual answer is? Science and materialism have repeatedly produced predictions that pan out in experiments. Theories of souls and sprituality have repeatedly had to retreat from testable predictions."
So, let's not have a theory of souls or spirituality at this point. We don't know enough. That doesn't mean that those things don't exist, it only means we don't understand them.
Suppose a cave man-level creature on another planet encounters an iPhone because we somehow send one there. This cave man creature knows how to build fires and has used reasoning to make weapons, etc. In doing those things, he probably tried different ideas about how best to make fires and rejected the ones that didn't work well. In other words, he has a rudimentary understanding of the scientific method.
Now he tries to figure out how an iPhone works. He constructs theories based on what he knows. The theories are all shown, over hundreds of years, to be wrong. Therefore, he is told, iPhones don't exist because when he constructs theories about them, they are wrong.
But he directly observes the existence of the iPhone because he holds it in his hand. He knows they exist. He doesn't need a scientific theory to prove that they exist. Maybe, eventually, he will have a correct scientific theory as to how they work; it will just take more time. Or maybe he never will. Either way, iPhones exist.
Awareness is, in my view, exactly the same, and it is mystifying to me that people such as yourself come to a different conclusion.