You might also enjoy this series: https://www.modular.com/democratizing-ai-compute which goes into a lot of the details.