This unfortunately is a red herring. Jetson Orin with 32GB is a more reasonable option. Yes it is expensive (950€ on arrow.de), but it is a niche product in the first place.
I wonder how stable those libraries mentioned are, and how much RAM is needed, because I cannot run LLMs at all on my Pis.
Title should be "Not Testing..."
This is just 5 paras of excuses for not testing squat.