I have a few Maxwell and Pascal series cards lying around, anywhere from 2GB to 11GB of VRAM. Have experimented with small/tiny models for agentic stuff with mixed results, however they are getting better at tool calling (before they'd just produce junk output that the harness couldn't parse).

I'm excited to see what we can squeeze out of older hardware, in the same spirit of demoscene or "will it run DOOM?".

Especially timely given current hardware scarcity. Will be watching this space.