Hacker News Reader

what's going to be interesting is to see the large space of fused kernels being tackled by AI generated code. that might include gemm + relu + gemm + a norm of some kind - which would be annoyingly exhaustive to 1. sweep with a tuner and 2. handwrite as a human

View on HN

Uh, what is a "kernel" in the sense of AI? Because it sure looks like this isn't an OS kernel.

This is GPU terminology:

https://cvw.cac.cornell.edu/gpu-architecture/gpu-characteris...

A function that is meant to be executed in parallel on an attached GPU is called a kernel. In CUDA, a kernel is usually identified by the presence of the __global__ specifier in front of an otherwise normal-looking C++ function declaration.

Reply on news.ycombinator.com