I was in a Wal-Mart last week and the front end lead I was talking to looked at her company phone and said that she had to come right back.
The store system cameras spotted something on the floor and messaged her, as the closest employee to the thing, to go pick it up.
I was astounded.
I first read it a long time ago, and it's looking more and more prescient. Not the specific tech, in fact it probably feels prescient because it doesn't talk about any particular tech, but the direction of travel feels very familiar.
Incidentally I now live in Australia...
This part made me chuckle about current AI systems and prompt injection
> The Vertabrane system is operating in the same way. It is learning things, not running programs. It acts consciously rather than being 'programmed', and it has a far more rigid moral code than most human beings do. The Vertebrane system never blindly 'executes' a program, so it cannot be taken over.
I would say that the fact that LLMs never execute a program but "learn" it, mean that they can for sure be taken over by very unpredictable means.