People are working on it but it's just down to how many floating point operations can you do? I wonder if something like the Coral would help?

I'd love having an LLM on a Pi, but I'll have to settle for a larger machine I can turn on to get more compute. At least for the time being.