If you can buy consumer grade GPU i'll for sure prefer that as you can buy 4x rtx 3090 in same price as one A6000 and for almost all use cases outside extremely big models it should be a lot better solution. (I have one PC with 4x rtx 3090 for DL and it is enough but sometimes as i need to run very big model i just turn on colab with TPU [inference] or rent A100 server as it'll be still cheaper then any other solution)

For CPU I cant say much cause we are always limited by PCIE speed in our use case and Xeons are idle most of the time :P