You also need VRAM for context: the larger the context, the more RAM you need.