Hacker News Reader

Would this also be possible with other LLM engines / GPUs? E.g. Llama / Apple Silicon or Radeon?

Yeah, none of this is specific to CUDA (though the relative latencies might be different).