(Contrarians, or meta-contrarians, may jump up to claim otherwise, but I would say that while the question of what a non-temporal consciousness could hypothetically be may be fun to debate, it is also so far out of our experience that it is clearly not what we generally mean by the term and is therefore a completely different conversation.)
LLMs do not strike me as amenable to fixing this. But that only applies to LLMs, not to any future architectures.