NVIDIA was bullied by both AMD and Intel when it wanted to make GPUs that are capable running x86 code.
IBM would pretty much kill ARM at least SoftBank left it be.
NVIDIA on the other hand will come with a strong vision and competency this is by far the most exciting shift in the semi market for years and we might finally get some competition in the CPU space.
You are talking about Desktop / Server CPUs I presume. The problem is that this is detrimental to the competition in the mobile / phone CPU space as Nvidia is a direct (although not very big) competitor to Qualcomm, MediaTek, Samsung, HiSilicon etc., but would now own the architecture everyone is using.
NVIDIA isn't a direct competitor to any of those, they had a single product Tegra that can even be considered a competition.
IBM knows how to license an ISA and has heard of open source. NVIDIA hates open source almost as much as Oracle. I'm pretty sure its not going to go well if NVIDIA gets ARM.