I think there will always be an API. In the case of Deep Learning you already see Caffe, TensorFlow, etc. readily available for developers.
I don't think the average developer will need to understand chip design but I do think _many_ developers will need to know how to use deep learning frameworks.