It will be interesting to see if LLMs “evolve” importance as they run out of ram and storage to think.
For humans with limited space, “Importance” is an output of a first pass “of the available infinite amount of information, what do I need to consider to solve this problem”. And it’s not necessarily a good algorithm. People misidentify “importance” all the time.