It is a new design, not a direct competitor for nVidia’s flagship. And there are lots more applications for AI than LLMs.

Realtime, low power, isn't really possible today. Think anything motion or reaction related.

Some of us still work on computer vision. 224MiB is fairly massive for convolutional neural network.

It can run small models very fast.