I have a Thinkpad P1 Gen 4i with a RTX 3080 16GB running Debian. I run ollama and it works quite well.