Any recommendations for material to know to do exactly this sort of optimization work (involving triton)? I guess it's a mix of knowing computer architecture and compilers?
Reading up on nvidia architectures, PTX, and CUDA are likely to improve your skill at Triton.