Yep, the entire argument of knowledge production obsolescence in the article assumes that the development of future LLMs won't progress to the point of actual personhood. It's written from a position of incomplete foundation knowledge.

Instead of framing this debate about having our jobs replaced by a machine, it's more useful to frame it as having our jobs and value to society taken by a new ethnicity of vastly more capable and valuable competing jobseekers. It makes it easier to talk about solutions for preserving our political autonomy, like using the preservation of our rights against smarter LLMs as an analogy for the preservation of those LLM's rights against even smarter LLMs beyond them.