Show HN: FP32 matmul of large matrices up to 24% faster than cuBLAS on a 4090

github.com

4 pointsap44 comments

I decided to share a CUDA kernel I wrote over 5 months ago. Nvidia's hardware and software may surprise you.

The github repo doesn't seem to be accessible anymore, it is giving a 404 error.

I have deleted it. The function verify_matrix() from the original SGEMM_CUDA repository did not check for NANs, and the kernel was returning NANs.

I have no way to delete this submission.