Yes ROCm is for the GPU, but the MI300A also includes 4 clusters of cpus connected by an infinity fabric. Generally this kind of thing is handled by the OS but there is no OS for this product.
I did a quick google search and found this presentation which details the programming model...
https://nowlab.cse.ohio-state.edu/static/media/workshops/pre...
Application authors who care about wringing out the last drop of performance need to be mindful about how they manage processes and cache lines on this hardware - as they would on any other architecture