they are very small, very advanced, and production yields are poor. The equipment is also stupidly expensive and takes reams of smart people just to run.
Silicon is currently the most advanced tech humans have ever made and those GPUs are on the cutting edge of that