I'm sick and tired of this memory austerity. Don't go blaming consumers for issues that the ai companies caused. I should be allowed to want a 32GB rpi5 for €75.
I'm sick and tired of this memory austerity. Don't go blaming consumers for issues that the ai companies caused. I should be allowed to want a 32GB rpi5 for €75.
my answer: i'd run an OS on ram, snapshot to an nvme periodically and still have enough ram for redis/sqlite/CI/build tools/ docker+network watchdogs/misc services..
.. AND STILL have enough ram to throw an 8b toy llm in there for good measure with a large context..
..at 5w.
if we get permitted to add a hailo board on top of that mythical 64gb rpi then a lot more fun opens up.
mind you my plans wouldnt change much if you said it was an intel N150 with 64gb of ram or some such, aside from the omission of the hailo hat.
If the CPU was more capable on the rpi5 i'd lean to VM host. If the GPU was more capable i'd lean to transcoding/caching system for a home media setup.