But isn't part of the problem that you simply don't have access to the hardware larger organisations do? OpenAI certainly run into the same constraints. but if they have access to terabytes of memory, while when you use the same model it's closer to 32GB, that will surely affect how the model behaves?

So the pain points you and I frequently run into, simply don't exist for a well connected individual(Sam Altman).