Then there's also the software issues. Nvidia has invested in GPU-based compute nonstop for the past 10+ years. Apple invested in Nvidia, then invested in OpenCL after abandoning Nvidia, then abandoned OpenCL for Metal compute which would eventually become the proprietary Accelerate framework. Nvidia's eggs are all organized in one, valuable basket. Apple's investments are spread out all over the place, with much of the time and money going into projects that don't even exist anymore.
Apple has the TSMC advantage, but that's just about it. Their GPU designs aren't comparably efficient or compute-oriented to what Nvidia ships today. Additionally, Nvidia will continue investing in places that Apple principally refuses to support. Unless a serious tide change occurs at Apple, they aren't going to get a fair competition with Nvidia.