All AGI built on our current computer architectures (von neumann) will essentially be zombies. They will never experience qualia. They won't have motivations or emotions, they will always be tools. It's fantasy to think otherwise.
Would you like to elaborate on why you think this? They will certainly not have human qualia the same way humans don't know what it is to be a bat (we barely know what it is to be another human). But it can have its own thought processes, right? I dont see how the von neuman architecture stops it from doing that.
It’s very anthropic to think that qualia must be continuous in time or concentrated in localized physical membranes. You easily may be right now an element of unsorted series of random quantum errors that generate your continuous “qualia” in a mostly empty universe in some unknown way, which isn’t even remotely (1;3).
Having motivations and having qualia have almost nothing to do with each other. The former just means having a goal system, and I can write an agent that has a goal system in ten lines of Python.
No, instructions are not the same as motivations. There needs to be something to be motivated, thus the need for qualia. Defining, say an optimization problem, or any algorithm, has no relation to motivation.
Your definition of the word does not agree with how it is commonly understood in psychology. But no matter, this is a question of semantics and thus intrinsically uninteresting. Not to mention the fact that any argument that asserts either the presence or absence of qualia in some system is, as of now, both unverifiable and unfalsifiable and thus without value.